log - ScrapydWeb

It's recommended to check out the latest log via: the Stats page >> View log >> Tail
PROJECT (sourcing_v2), SPIDER (auto1.it)

2026-01-28 10:00:42 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 10:00:42 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 10:00:42 [auto1.it] INFO: Starting spider auto1.it
2026-01-28 10:00:42 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 10:00:42 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 10:00:42 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 10:00:42 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 10:00:42 [scrapy.extensions.telnet] INFO: Telnet Password: 564797ef8c7bd4f4
2026-01-28 10:00:42 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 10:00:42 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_75_2026-01-28T10_00_04.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 10:00:43 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 10:00:43 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 10:00:43 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 10:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 10:00:43 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 10:00:43 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 10:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:00:43 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 10:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 10:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:43 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-28 10:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-28 10:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 10:00:43 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 10:00:43 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 10:00:43 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 10:00:43 [scrapy.core.engine] INFO: Spider opened
2026-01-28 10:00:43 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 10:00:43 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6029
2026-01-28 10:00:43 [scrapy-playwright] INFO: Starting download handler
2026-01-28 10:00:43 [scrapy-playwright] INFO: Starting download handler
2026-01-28 10:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-28 10:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-28 10:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-28 10:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-28 10:00:52 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:00:52 [auto1.it] INFO: Found listing with ID: JH70368
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for JH70368: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: YY00281
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for YY00281: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: NV22132
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV22132%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for NV22132: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: LB37983
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB37983%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for LB37983: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: KX23576
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX23576%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for KX23576: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: WG22278
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for WG22278: 2
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: KP25474
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP25474%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for KP25474: 2
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: WT70784
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT70784%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for WT70784: 1
2026-01-28 10:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: XM98126
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for XM98126: 2
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: GV70344
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV70344%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for GV70344: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: WP79549
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP79549%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for WP79549: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: NX34632
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX34632%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for NX34632: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: LV69875
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV69875%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for LV69875: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: PE10297
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE10297%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for PE10297: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: TU81293
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU81293%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for TU81293: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: AK19049
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK19049%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for AK19049: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: VK07610
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for VK07610: 2
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: UD53703
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD53703%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for UD53703: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: AW83792
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83792%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for AW83792: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: SC19366
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC19366%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for SC19366: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: TH81920
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH81920%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for TH81920: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: UW96841
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96841%27 HTTP/1.1" 200 None
2026-01-28 10:00:53 [auto1.it] INFO: Scrape type for UW96841: 1
2026-01-28 10:00:53 [auto1.it] INFO: Found listing with ID: MP68527
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP68527%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for MP68527: 1
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: RE03903
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE03903%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for RE03903: 1
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH70368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: DZ55749
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ55749%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for DZ55749: 2
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: FR07363
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR07363%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for FR07363: 1
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: YU94462
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for YU94462: 1
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY00281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: VP15604
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP15604%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for VP15604: 1
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV22132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: UV42227
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV42227%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for UV42227: 1
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX23576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: CK01527
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for CK01527: 1
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB37983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: UU45503
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU45503%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for UU45503: 1
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG22278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP25474/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:54 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: YS60698
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for YS60698: 2
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: JH70368
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: MA63889
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA63889%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for MA63889: 1
2026-01-28 10:00:54 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/JH70368/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: YY00281
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: PA09787
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA09787%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for PA09787: 1
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: NV22132
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: EM48651
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM48651%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for EM48651: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: LB37983
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: US18527
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US18527%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for US18527: 1
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: KX23576
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: LG07242
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for LG07242: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: WG22278
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for WG22278: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: UV47695
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for UV47695: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: KP25474
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP25474%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for KP25474: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: MX11198
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for MX11198: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: WT70784
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: YR64297
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR64297%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for YR64297: 1
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: XM98126
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for XM98126: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: GV70344
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: WP79549
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: NX34632
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: LV69875
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: PE10297
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: TU81293
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: AK19049
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: VK07610
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2026-01-28 10:00:54 [auto1.it] INFO: Scrape type for VK07610: 2
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: UD53703
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: AW83792
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: SC19366
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: TH81920
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: UW96841
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: MP68527
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: RE03903
2026-01-28 10:00:54 [auto1.it] INFO: Found listing with ID: DZ55749
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ55749%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for DZ55749: 2
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: FR07363
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: YU94462
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: VP15604
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: UV42227
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: CK01527
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: UU45503
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: YS60698
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for YS60698: 2
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: MA63889
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV70344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: PA09787
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: EM48651
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM48651%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for EM48651: 2
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: US18527
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: LG07242
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for LG07242: 2
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: UV47695
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for UV47695: 2
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: MX11198
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2026-01-28 10:00:55 [auto1.it] INFO: Scrape type for MX11198: 2
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT70784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [auto1.it] INFO: Found listing with ID: YR64297
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX34632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM98126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE10297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU81293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP79549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV69875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP15604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU94462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR07363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK01527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV42227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE03903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU45503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH70368> (referer: https://www.auto1.com/v1/car-details-view/JH70368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1526a0d-a716-58ce-ada1-3d333c78d1e8 with identifier: JH70368
2026-01-28 10:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1526a0d-a716-58ce-ada1-3d333c78d1e8 with scrape type 1
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg not downloaded yet
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg not downloaded yet
2026-01-28 10:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR64297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg not downloaded yet
2026-01-28 10:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_77934417c16c03d4cbe8f383f54ec48f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_77934417c16c03d4cbe8f383f54ec48f.jpg not downloaded yet
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_6e80dbc423252d49e027de38b128348a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_6e80dbc423252d49e027de38b128348a.jpg not downloaded yet
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_fa37e016fcb362820eef795a33d7ff9f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_fa37e016fcb362820eef795a33d7ff9f.jpg not downloaded yet
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_3a964ace0577ee416034102e02f7a4aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_3a964ace0577ee416034102e02f7a4aa.jpg not downloaded yet
2026-01-28 10:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_9fefa346efdb01c4fd4189df1456fd22.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9fefa346efdb01c4fd4189df1456fd22.jpg not downloaded yet
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg not downloaded yet
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_805445061ce7693318a094f7188173da.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_805445061ce7693318a094f7188173da.jpg not downloaded yet
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg not downloaded yet
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_2fea54ce2745587c1eadb16887a27ff0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_2fea54ce2745587c1eadb16887a27ff0.jpg not downloaded yet
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg not downloaded yet
2026-01-28 10:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX11198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_9a722e53db8d1a38885891184e20f3b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9a722e53db8d1a38885891184e20f3b4.jpg not downloaded yet
2026-01-28 10:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_c845b525660ed54db2ff890abf936252.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_c845b525660ed54db2ff890abf936252.jpg not downloaded yet
2026-01-28 10:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV47695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_c845b525660ed54db2ff890abf936252.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef70bd0>
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg') HTTP/1.1" 204 0
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg saved to cache
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT70784> (referer: https://www.auto1.com/v1/car-details-view/WT70784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM98126> (referer: https://www.auto1.com/v1/car-details-view/XM98126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX34632> (referer: https://www.auto1.com/v1/car-details-view/NX34632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE10297> (referer: https://www.auto1.com/v1/car-details-view/PE10297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV70344> (referer: https://www.auto1.com/v1/car-details-view/GV70344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV69875> (referer: https://www.auto1.com/v1/car-details-view/LV69875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f411c2d0>
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_c845b525660ed54db2ff890abf936252.jpg') HTTP/1.1" 204 0
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_c845b525660ed54db2ff890abf936252.jpg saved to cache
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP15604> (referer: https://www.auto1.com/v1/car-details-view/VP15604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4227d10>
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg') HTTP/1.1" 204 0
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg saved to cache
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4242c0ca-f599-523c-917e-550058bf189b with identifier: WT70784
2026-01-28 10:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4242c0ca-f599-523c-917e-550058bf189b with scrape type 1
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4242c0ca-f599-523c-917e-550058bf189b
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_1395fa51d630ff6245eedb022547f693.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_1395fa51d630ff6245eedb022547f693.jpg already downloaded
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_3dd8ab414b42e3645128cbcaba8a294e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3dd8ab414b42e3645128cbcaba8a294e.jpg already downloaded
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_108590fec74b28500ff79d694de0df85.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_108590fec74b28500ff79d694de0df85.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_3243ea3ce610500d0fda38dde8e9d82e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3243ea3ce610500d0fda38dde8e9d82e.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_ad5b2fef7a63b7af453e6ceea4fcfc9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ad5b2fef7a63b7af453e6ceea4fcfc9d.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_f3c8d4eeb647d76000a4033c631a7c63.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f3c8d4eeb647d76000a4033c631a7c63.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_fdc85fd7524fe3969680f3f56ecefdc8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_fdc85fd7524fe3969680f3f56ecefdc8.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_63f83b4db75732f6626abbef241468c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_63f83b4db75732f6626abbef241468c8.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_bea71427938936be6bfe1021e74ef227.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_bea71427938936be6bfe1021e74ef227.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_cb68c04b7d10ad9df85e002bcf8c6e86.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_cb68c04b7d10ad9df85e002bcf8c6e86.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_ceaedbaa62a94c6539ac9dc8a3629770.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ceaedbaa62a94c6539ac9dc8a3629770.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_ce9c3334cc6a233ef8106e9c8c77ecec.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ce9c3334cc6a233ef8106e9c8c77ecec.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_a7c2f177bb790d508b3a8a172ee2a748.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_a7c2f177bb790d508b3a8a172ee2a748.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_b230033a4d2998619646abf5cb242134.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_b230033a4d2998619646abf5cb242134.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F4b%252Fe84bf151d81d06b11bfd6aee314f1124%252Fpa%252FWT70784_f6b640d5a46d8c93eeb4f5d0a1e73e6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f6b640d5a46d8c93eeb4f5d0a1e73e6e.jpg already downloaded
2026-01-28 10:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4242c0ca-f599-523c-917e-550058bf189b, identifier: WT70784
2026-01-28 10:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2026-01-28 10:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with scrape type 2
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with scrape type 2
2026-01-28 10:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d37cc5f1-9fea-5224-8f2e-8d89916f0a29, identifier: XM98126
2026-01-28 10:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab5ee693-55cf-527a-a182-d2284d05754f with identifier: NX34632
2026-01-28 10:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5ee693-55cf-527a-a182-d2284d05754f with scrape type 1
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_695dde3ac192fbabcdf9580d84dcf505.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_695dde3ac192fbabcdf9580d84dcf505.jpg not downloaded yet
2026-01-28 10:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b4358a-6ba4-5158-b54e-a3e709a503de with identifier: PE10297
2026-01-28 10:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b4358a-6ba4-5158-b54e-a3e709a503de with scrape type 1
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 90b4358a-6ba4-5158-b54e-a3e709a503de
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_3921cb8784fb115a5d41ff6786d057cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3921cb8784fb115a5d41ff6786d057cd.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_003390fc6015b013edede3fa5a9f18b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_003390fc6015b013edede3fa5a9f18b5.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_14986bb957d0a290275f08147415f549.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_14986bb957d0a290275f08147415f549.jpg already downloaded
2026-01-28 10:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_c1a70083d1c7c0d7aa7afcef24125e2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_c1a70083d1c7c0d7aa7afcef24125e2a.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_98eb166aee0c6d1573f2af4118842986.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_98eb166aee0c6d1573f2af4118842986.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_3ea7b03d59682b2cf130413d49ce236d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3ea7b03d59682b2cf130413d49ce236d.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_b9b5c9c4610f2acc753bdf50d1b38626.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_b9b5c9c4610f2acc753bdf50d1b38626.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_2af9542b07ac9b01fe1d7195a68733df.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_2af9542b07ac9b01fe1d7195a68733df.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_9600dd92a16b821b6c773890e5e3a081.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_9600dd92a16b821b6c773890e5e3a081.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_ad464fbaa1d8d3ba387d581a2faf1478.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_ad464fbaa1d8d3ba387d581a2faf1478.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_fd53b91ce455226f1d72b1a4cbfe3302.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_fd53b91ce455226f1d72b1a4cbfe3302.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_88d2a296c94290eb39c940d0f6588fa2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_88d2a296c94290eb39c940d0f6588fa2.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_0dba4d4ae7c7284ddff6c27ff4c31ac2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_0dba4d4ae7c7284ddff6c27ff4c31ac2.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_5b87c1645e593d017afd3bf0e449c697.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_5b87c1645e593d017afd3bf0e449c697.jpg already downloaded
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F61%252F7161d9380f7e7d576b547f0291c665ff%252Fpa%252FPE10297_67aac8fad257d0c0c8910c913bb2e884.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_67aac8fad257d0c0c8910c913bb2e884.jpg already downloaded
2026-01-28 10:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90b4358a-6ba4-5158-b54e-a3e709a503de, identifier: PE10297
2026-01-28 10:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with identifier: GV70344
2026-01-28 10:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with scrape type 1
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_9ef948644a6e3c9806dfbd73da89780b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_9ef948644a6e3c9806dfbd73da89780b.jpg not downloaded yet
2026-01-28 10:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cb7118-cc05-5fed-b651-d179f3b6ab53 with identifier: LV69875
2026-01-28 10:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cb7118-cc05-5fed-b651-d179f3b6ab53 with scrape type 1
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_f515b8e8066286cc41abdb101078e6f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_f515b8e8066286cc41abdb101078e6f3.jpg not downloaded yet
2026-01-28 10:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4242c0ca-f599-523c-917e-550058bf189b with identifier: WT70784
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-28 10:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4242c0ca-f599-523c-917e-550058bf189b with identifier: WT70784
2026-01-28 10:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4242c0ca-f599-523c-917e-550058bf189b with identifier: WT70784 to the API
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WT70784>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:01:15Z',
 'fuel_type': 'petrol',
 'id': '4242c0ca-f599-523c-917e-550058bf189b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT70784',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 30170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_1395fa51d630ff6245eedb022547f693.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3dd8ab414b42e3645128cbcaba8a294e.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_108590fec74b28500ff79d694de0df85.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3243ea3ce610500d0fda38dde8e9d82e.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ad5b2fef7a63b7af453e6ceea4fcfc9d.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f3c8d4eeb647d76000a4033c631a7c63.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_fdc85fd7524fe3969680f3f56ecefdc8.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_63f83b4db75732f6626abbef241468c8.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_bea71427938936be6bfe1021e74ef227.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_cb68c04b7d10ad9df85e002bcf8c6e86.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ceaedbaa62a94c6539ac9dc8a3629770.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ce9c3334cc6a233ef8106e9c8c77ecec.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_a7c2f177bb790d508b3a8a172ee2a748.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_b230033a4d2998619646abf5cb242134.jpg',
                'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f6b640d5a46d8c93eeb4f5d0a1e73e6e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_1395fa51d630ff6245eedb022547f693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3dd8ab414b42e3645128cbcaba8a294e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_108590fec74b28500ff79d694de0df85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_3243ea3ce610500d0fda38dde8e9d82e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ad5b2fef7a63b7af453e6ceea4fcfc9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f3c8d4eeb647d76000a4033c631a7c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_fdc85fd7524fe3969680f3f56ecefdc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_63f83b4db75732f6626abbef241468c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_bea71427938936be6bfe1021e74ef227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_cb68c04b7d10ad9df85e002bcf8c6e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ceaedbaa62a94c6539ac9dc8a3629770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_ce9c3334cc6a233ef8106e9c8c77ecec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_a7c2f177bb790d508b3a8a172ee2a748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_b230033a4d2998619646abf5cb242134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4242c0ca-f599-523c-917e-550058bf189b/4242c0ca-f599-523c-917e-550058bf189b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/4b/e84bf151d81d06b11bfd6aee314f1124/pa/WT70784_f6b640d5a46d8c93eeb4f5d0a1e73e6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2023}
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT70784%27 HTTP/1.1" 200 None
2026-01-28 10:01:01 [auto1.it] INFO: Saving data for WT70784: {'created_time': 1769594461.653997, 'last_price_update_time': 1769594461.654014, 'auction_closing_time': 1769702475.0}
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WT70784') HTTP/1.1" 204 0
2026-01-28 10:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-28 10:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-28 10:01:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 with identifier: XM98126
2026-01-28 10:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195459 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195459
2026-01-28 10:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 spider: auto1.it
2026-01-28 10:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d37cc5f1-9fea-5224-8f2e-8d89916f0a29 due to rule: high_mileage_for_country.json, error: 195459 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195459
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:12Z',
 'fuel_type': 'diesel',
 'id': 'd37cc5f1-9fea-5224-8f2e-8d89916f0a29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM98126',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 195459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D3 Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2018}
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2026-01-28 10:01:02 [auto1.it] INFO: Saving data for XM98126: {'auction_closing_time': 1769703312.0, 'created_time': 1766434142.25993, 'last_price_update_time': 1769594462.384334}
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM98126') HTTP/1.1" 204 0
2026-01-28 10:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90b4358a-6ba4-5158-b54e-a3e709a503de with identifier: PE10297
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-28 10:01:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90b4358a-6ba4-5158-b54e-a3e709a503de with identifier: PE10297
2026-01-28 10:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90b4358a-6ba4-5158-b54e-a3e709a503de with identifier: PE10297 to the API
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE10297>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:56Z',
 'fuel_type': 'diesel',
 'id': '90b4358a-6ba4-5158-b54e-a3e709a503de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE10297',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 97003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3921cb8784fb115a5d41ff6786d057cd.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_003390fc6015b013edede3fa5a9f18b5.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_14986bb957d0a290275f08147415f549.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_c1a70083d1c7c0d7aa7afcef24125e2a.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_98eb166aee0c6d1573f2af4118842986.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3ea7b03d59682b2cf130413d49ce236d.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_b9b5c9c4610f2acc753bdf50d1b38626.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_2af9542b07ac9b01fe1d7195a68733df.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_9600dd92a16b821b6c773890e5e3a081.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_ad464fbaa1d8d3ba387d581a2faf1478.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_fd53b91ce455226f1d72b1a4cbfe3302.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_88d2a296c94290eb39c940d0f6588fa2.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_0dba4d4ae7c7284ddff6c27ff4c31ac2.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_5b87c1645e593d017afd3bf0e449c697.jpg',
                'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_67aac8fad257d0c0c8910c913bb2e884.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53630,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3921cb8784fb115a5d41ff6786d057cd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51364,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_003390fc6015b013edede3fa5a9f18b5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49988,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_14986bb957d0a290275f08147415f549.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33209,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_c1a70083d1c7c0d7aa7afcef24125e2a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42939,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_98eb166aee0c6d1573f2af4118842986.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40878,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_3ea7b03d59682b2cf130413d49ce236d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30809,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_b9b5c9c4610f2acc753bdf50d1b38626.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49076,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_2af9542b07ac9b01fe1d7195a68733df.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47100,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_9600dd92a16b821b6c773890e5e3a081.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31370,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_ad464fbaa1d8d3ba387d581a2faf1478.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33458,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_fd53b91ce455226f1d72b1a4cbfe3302.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38011,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_88d2a296c94290eb39c940d0f6588fa2.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_0dba4d4ae7c7284ddff6c27ff4c31ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29443,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_5b87c1645e593d017afd3bf0e449c697.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b4358a-6ba4-5158-b54e-a3e709a503de/90b4358a-6ba4-5158-b54e-a3e709a503de_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/61/7161d9380f7e7d576b547f0291c665ff/pa/PE10297_67aac8fad257d0c0c8910c913bb2e884.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE10297%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [auto1.it] INFO: Saving data for PE10297: {'created_time': 1769594463.139367, 'last_price_update_time': 1769594463.139384, 'auction_closing_time': 1769703356.0}
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PE10297') HTTP/1.1" 204 0
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_26a94fec62520ef4196d466359ca1f13.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_26a94fec62520ef4196d466359ca1f13.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_6de35f29d9575018974983fbef43be67.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6de35f29d9575018974983fbef43be67.jpg not downloaded yet
2026-01-28 10:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP79549> (referer: https://www.auto1.com/v1/car-details-view/WP79549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e2179f-40df-578f-9a2e-8062f76dfbeb with identifier: VP15604
2026-01-28 10:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e2179f-40df-578f-9a2e-8062f76dfbeb with scrape type 1
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_d230c0af50e149480371d1903e8bf802.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d230c0af50e149480371d1903e8bf802.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg not downloaded yet
2026-01-28 10:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_ce1c4b48da79b1a197a020b6090e63af.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ce1c4b48da79b1a197a020b6090e63af.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_5e3168499973c9ba91a315390130ab20.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_5e3168499973c9ba91a315390130ab20.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_b4756dcfbdba62d34a90b4625f858f45.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_b4756dcfbdba62d34a90b4625f858f45.jpg not downloaded yet
2026-01-28 10:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 435f0d34-da7f-592c-bfb8-c498ddc3016f with identifier: WP79549
2026-01-28 10:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435f0d34-da7f-592c-bfb8-c498ddc3016f with scrape type 1
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_8b913833db999edc1a950c3c34354a8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8b913833db999edc1a950c3c34354a8c.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_72f77496a55d0252539c31e3c81b0fed.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_72f77496a55d0252539c31e3c81b0fed.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg not downloaded yet
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_24d340a107602c4aea98456c3264efed.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_24d340a107602c4aea98456c3264efed.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_b81c43423e588d086fcc29aef982f441.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_b81c43423e588d086fcc29aef982f441.jpg not downloaded yet
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US18527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_15ab064a4dbe38e52209a76f46b0a370.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_15ab064a4dbe38e52209a76f46b0a370.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_04cb0897b290f6f934639983e4600ccc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_04cb0897b290f6f934639983e4600ccc.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg not downloaded yet
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG07242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_cd245740c270c701a7a0c6867f987f25.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_cd245740c270c701a7a0c6867f987f25.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_76e8b524fc926240389714c4b3290e2c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_76e8b524fc926240389714c4b3290e2c.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg not downloaded yet
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR07363> (referer: https://www.auto1.com/v1/car-details-view/FR07363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU94462> (referer: https://www.auto1.com/v1/car-details-view/YU94462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU81293> (referer: https://www.auto1.com/v1/car-details-view/TU81293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_d62767dabbde536ee88933f3416e73ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_d62767dabbde536ee88933f3416e73ad.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_890c925c5f088163597b3228e53cd3f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_890c925c5f088163597b3228e53cd3f9.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_9b27baa1678ed24b16c7df023a763c0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_9b27baa1678ed24b16c7df023a763c0e.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_203df7875b2a26eb33fe00b48c85c810.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_203df7875b2a26eb33fe00b48c85c810.jpg not downloaded yet
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX11198> (referer: https://www.auto1.com/v1/car-details-view/MX11198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_0675f976ad60c3cffbbcdaf84243537b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_0675f976ad60c3cffbbcdaf84243537b.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_07fb632afae2f4488c461e07bebbb1ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_07fb632afae2f4488c461e07bebbb1ac.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_41c18f01c02f896a674a508727ac9deb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_41c18f01c02f896a674a508727ac9deb.jpg not downloaded yet
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_418ba7996392db75e755f49d6020b1a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_418ba7996392db75e755f49d6020b1a8.jpg not downloaded yet
2026-01-28 10:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg not downloaded yet
2026-01-28 10:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e87568-e553-54d2-ae1e-0e882b55353e with identifier: FR07363
2026-01-28 10:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e87568-e553-54d2-ae1e-0e882b55353e with scrape type 1
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e2e87568-e553-54d2-ae1e-0e882b55353e
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_e4ba1ca9c7512dfabc17349b7232e4c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_e4ba1ca9c7512dfabc17349b7232e4c6.jpg already downloaded
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_b11380fd4540a816ecc4b008b1c81a54.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b11380fd4540a816ecc4b008b1c81a54.jpg already downloaded
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_a62f7879faea4107891d6921f6c1f9b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_a62f7879faea4107891d6921f6c1f9b6.jpg already downloaded
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_641315b9ef2ec2e8cb5413b8dbdc4264.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_641315b9ef2ec2e8cb5413b8dbdc4264.jpg already downloaded
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_70f11d65faa4a0ad1f43209f6624521d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_70f11d65faa4a0ad1f43209f6624521d.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_cfeb2e2a0e4172bf9b41df112c56956c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_cfeb2e2a0e4172bf9b41df112c56956c.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_20a9b635cfe380f992b91e6ec1285d4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_20a9b635cfe380f992b91e6ec1285d4c.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_68da01388a1b84bf65a050ed4dcccfe7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_68da01388a1b84bf65a050ed4dcccfe7.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_ab4967cdd43bc8bcdedf58681be2a9a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_ab4967cdd43bc8bcdedf58681be2a9a5.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_63b25fe0f666f39ae0011d4c52df947b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_63b25fe0f666f39ae0011d4c52df947b.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_b4d8fddbde0b56ccd29a00debec46dbb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b4d8fddbde0b56ccd29a00debec46dbb.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_529dbca6705b68d9ee231a01efac0560.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_529dbca6705b68d9ee231a01efac0560.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_3b854eccec53553e8663068d4172fd37.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_3b854eccec53553e8663068d4172fd37.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_0f26de1bd73dba4912aced251a640dcc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_0f26de1bd73dba4912aced251a640dcc.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe1%252F8ee16ceaae5cccf4a3b7ebc83792b9cf%252Fpa%252FFR07363_f74c2479a523d0ee4f6936d56a3b9f64.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_f74c2479a523d0ee4f6936d56a3b9f64.jpg already downloaded
2026-01-28 10:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2e87568-e553-54d2-ae1e-0e882b55353e, identifier: FR07363
2026-01-28 10:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2026-01-28 10:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ae9eda3-0726-503d-aca5-c9e5181a190d with scrape type 1
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6ae9eda3-0726-503d-aca5-c9e5181a190d
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_2283cc7c8d44167cf71bf1186097b5e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_2283cc7c8d44167cf71bf1186097b5e3.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_522360a8ff4b53647d4a49f86cdd2ddc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_522360a8ff4b53647d4a49f86cdd2ddc.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_95340ee062ea998edbdc0685738d3e21.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_95340ee062ea998edbdc0685738d3e21.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_3fd3212fed316c09a3c5b3230f832c01.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3fd3212fed316c09a3c5b3230f832c01.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_c05e43665e3a3bf164c3134f2f329afb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_c05e43665e3a3bf164c3134f2f329afb.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_5df296c97b660f95ca0c08762cf99604.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_5df296c97b660f95ca0c08762cf99604.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_8a8bc9fa955ef1a1e313527b47d6ba31.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8a8bc9fa955ef1a1e313527b47d6ba31.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_149914137f470ac659c1309f997173c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_149914137f470ac659c1309f997173c6.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_3dd48a12493faf061c4d903b52570cf2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3dd48a12493faf061c4d903b52570cf2.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_0521d725d7df97544809437715266fc1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_0521d725d7df97544809437715266fc1.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_ef5cd203ea7826c6578f52eb703a7a71.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_ef5cd203ea7826c6578f52eb703a7a71.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_7692f06426248159e15f95f99eb9d25d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_7692f06426248159e15f95f99eb9d25d.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_8fbfe01ac864226c1ebe0271b65bd11b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8fbfe01ac864226c1ebe0271b65bd11b.jpg already downloaded
2026-01-28 10:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_fad9b1da0d9a096244bc5013fc641a95.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_fad9b1da0d9a096244bc5013fc641a95.jpg already downloaded
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F1b%252Fa21bc593f9a89937de3452b5f3f0c11b%252Fpa%252FYU94462_1f5c951e1d21838101215f84f0da8476.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_1f5c951e1d21838101215f84f0da8476.jpg already downloaded
2026-01-28 10:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ae9eda3-0726-503d-aca5-c9e5181a190d, identifier: YU94462
2026-01-28 10:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a1bb99-dd3f-5e10-b62d-29f076b572ab with identifier: TU81293
2026-01-28 10:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab with scrape type 1
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_c6073e78f47607e025e18fd03aea5034.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_c6073e78f47607e025e18fd03aea5034.jpg not downloaded yet
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_fffa17c32680744cbe1f22dff78060e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_fffa17c32680744cbe1f22dff78060e0.jpg not downloaded yet
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg not downloaded yet
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_058b3e3516e68492479d7369645ea0fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_058b3e3516e68492479d7369645ea0fe.jpg not downloaded yet
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_26aa518d477668b4363acf1ac221666c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_26aa518d477668b4363acf1ac221666c.jpg not downloaded yet
2026-01-28 10:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2e87568-e553-54d2-ae1e-0e882b55353e with identifier: FR07363
2026-01-28 10:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2e87568-e553-54d2-ae1e-0e882b55353e with identifier: FR07363
2026-01-28 10:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-28 10:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e2e87568-e553-54d2-ae1e-0e882b55353e spider: auto1.it
2026-01-28 10:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e2e87568-e553-54d2-ae1e-0e882b55353e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:37:22Z',
 'fuel_type': 'diesel',
 'id': 'e2e87568-e553-54d2-ae1e-0e882b55353e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR07363',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 45098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_e4ba1ca9c7512dfabc17349b7232e4c6.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b11380fd4540a816ecc4b008b1c81a54.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_a62f7879faea4107891d6921f6c1f9b6.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_641315b9ef2ec2e8cb5413b8dbdc4264.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_70f11d65faa4a0ad1f43209f6624521d.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_cfeb2e2a0e4172bf9b41df112c56956c.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_20a9b635cfe380f992b91e6ec1285d4c.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_68da01388a1b84bf65a050ed4dcccfe7.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_ab4967cdd43bc8bcdedf58681be2a9a5.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_63b25fe0f666f39ae0011d4c52df947b.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b4d8fddbde0b56ccd29a00debec46dbb.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_529dbca6705b68d9ee231a01efac0560.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_3b854eccec53553e8663068d4172fd37.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_0f26de1bd73dba4912aced251a640dcc.jpg',
                'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_f74c2479a523d0ee4f6936d56a3b9f64.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_e4ba1ca9c7512dfabc17349b7232e4c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b11380fd4540a816ecc4b008b1c81a54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_a62f7879faea4107891d6921f6c1f9b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_641315b9ef2ec2e8cb5413b8dbdc4264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_70f11d65faa4a0ad1f43209f6624521d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_cfeb2e2a0e4172bf9b41df112c56956c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_20a9b635cfe380f992b91e6ec1285d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_68da01388a1b84bf65a050ed4dcccfe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_ab4967cdd43bc8bcdedf58681be2a9a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_63b25fe0f666f39ae0011d4c52df947b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_b4d8fddbde0b56ccd29a00debec46dbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_529dbca6705b68d9ee231a01efac0560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_3b854eccec53553e8663068d4172fd37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_0f26de1bd73dba4912aced251a640dcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e87568-e553-54d2-ae1e-0e882b55353e/e2e87568-e553-54d2-ae1e-0e882b55353e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e1/8ee16ceaae5cccf4a3b7ebc83792b9cf/pa/FR07363_f74c2479a523d0ee4f6936d56a3b9f64.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2024}
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR07363%27 HTTP/1.1" 200 None
2026-01-28 10:01:06 [auto1.it] INFO: Saving data for FR07363: {'created_time': 1769594466.750539, 'last_price_update_time': 1769594466.750556, 'auction_closing_time': 1769704642.0}
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR07363') HTTP/1.1" 204 0
2026-01-28 10:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2026-01-28 10:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-28 10:01:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2026-01-28 10:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462 to the API
2026-01-28 10:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU94462>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:10:11Z',
 'fuel_type': 'petrol',
 'id': '6ae9eda3-0726-503d-aca5-c9e5181a190d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU94462',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 30857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_2283cc7c8d44167cf71bf1186097b5e3.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_522360a8ff4b53647d4a49f86cdd2ddc.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_95340ee062ea998edbdc0685738d3e21.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3fd3212fed316c09a3c5b3230f832c01.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_c05e43665e3a3bf164c3134f2f329afb.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_5df296c97b660f95ca0c08762cf99604.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8a8bc9fa955ef1a1e313527b47d6ba31.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_149914137f470ac659c1309f997173c6.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3dd48a12493faf061c4d903b52570cf2.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_0521d725d7df97544809437715266fc1.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_ef5cd203ea7826c6578f52eb703a7a71.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_7692f06426248159e15f95f99eb9d25d.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8fbfe01ac864226c1ebe0271b65bd11b.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_fad9b1da0d9a096244bc5013fc641a95.jpg',
                'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_1f5c951e1d21838101215f84f0da8476.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_2283cc7c8d44167cf71bf1186097b5e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_522360a8ff4b53647d4a49f86cdd2ddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_95340ee062ea998edbdc0685738d3e21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3fd3212fed316c09a3c5b3230f832c01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_c05e43665e3a3bf164c3134f2f329afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_5df296c97b660f95ca0c08762cf99604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8a8bc9fa955ef1a1e313527b47d6ba31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_149914137f470ac659c1309f997173c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_3dd48a12493faf061c4d903b52570cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_0521d725d7df97544809437715266fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_ef5cd203ea7826c6578f52eb703a7a71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_7692f06426248159e15f95f99eb9d25d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ae9eda3-0726-503d-aca5-c9e5181a190d/6ae9eda3-0726-503d-aca5-c9e5181a190d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63251,
             'Height': 541,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_8fbfe01ac864226c1ebe0271b65bd11b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_fad9b1da0d9a096244bc5013fc641a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae8ec44-cbe7-51f9-bd82-c2c539050fad/5ae8ec44-cbe7-51f9-bd82-c2c539050fad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/1b/a21bc593f9a89937de3452b5f3f0c11b/pa/YU94462_1f5c951e1d21838101215f84f0da8476.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [auto1.it] INFO: Saving data for YU94462: {'created_time': 1769594468.278715, 'last_price_update_time': 1769594468.278734, 'auction_closing_time': 1769703011.0}
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU94462') HTTP/1.1" 204 0
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg not downloaded yet
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg not downloaded yet
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_3b8f531cf585eda37a2c54c69159cf11.png%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_3b8f531cf585eda37a2c54c69159cf11.png not downloaded yet
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_840de5b8f7408052b869a94d1b17973b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_840de5b8f7408052b869a94d1b17973b.jpg not downloaded yet
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg not downloaded yet
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_abb6a2e1130ed262f989002a6f303488.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_abb6a2e1130ed262f989002a6f303488.jpg not downloaded yet
2026-01-28 10:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR64297> (referer: https://www.auto1.com/v1/car-details-view/YR64297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV47695> (referer: https://www.auto1.com/v1/car-details-view/UV47695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2026-01-28 10:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75018bd5-e8d0-53e5-84da-c0b721745954 with scrape type 2
2026-01-28 10:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75018bd5-e8d0-53e5-84da-c0b721745954 with scrape type 2
2026-01-28 10:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75018bd5-e8d0-53e5-84da-c0b721745954, identifier: MX11198
2026-01-28 10:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee20a810>
2026-01-28 10:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg saved to cache
2026-01-28 10:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_b81c43423e588d086fcc29aef982f441.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg not downloaded yet
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_02fc7228f15398d063a8e7aa0640f57e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_02fc7228f15398d063a8e7aa0640f57e.jpg not downloaded yet
2026-01-28 10:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-28 10:01:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198
2026-01-28 10:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75018bd5-e8d0-53e5-84da-c0b721745954 with identifier: MX11198 to the API
2026-01-28 10:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX11198>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:56:32Z',
 'fuel_type': 'petrol',
 'id': '75018bd5-e8d0-53e5-84da-c0b721745954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX11198',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 35257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [auto1.it] INFO: Saving data for MX11198: {'auction_closing_time': 1769705792.0, 'created_time': 1768853161.271818, 'last_price_update_time': 1769594470.414478}
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX11198') HTTP/1.1" 204 0
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg not downloaded yet
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_805b74b18e2bca082b2686a00ecb5447.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_805b74b18e2bca082b2686a00ecb5447.jpg not downloaded yet
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_d6f945e2370aabef4a94f5304110fa6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_d6f945e2370aabef4a94f5304110fa6a.jpg not downloaded yet
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg not downloaded yet
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_8090f228d8977472393ad80d203777b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8090f228d8977472393ad80d203777b5.jpg not downloaded yet
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_17da5de46c42b028ea74421e73854842.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_17da5de46c42b028ea74421e73854842.jpg not downloaded yet
2026-01-28 10:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b54c372-4263-5683-aaaf-64269cdcee90 with identifier: YR64297
2026-01-28 10:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b54c372-4263-5683-aaaf-64269cdcee90 with scrape type 1
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg not downloaded yet
2026-01-28 10:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2026-01-28 10:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3342bba9-2d13-5623-9104-beb227bf1fe4 with scrape type 2
2026-01-28 10:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3342bba9-2d13-5623-9104-beb227bf1fe4 with scrape type 2
2026-01-28 10:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3342bba9-2d13-5623-9104-beb227bf1fe4, identifier: UV47695
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png%27 HTTP/1.1" 200 None
2026-01-28 10:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png not downloaded yet
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_67bcde26e46c2a4acf973d073273f46f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_67bcde26e46c2a4acf973d073273f46f.jpg not downloaded yet
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_ca41da94f5ec40e30277b7df816212f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ca41da94f5ec40e30277b7df816212f2.jpg not downloaded yet
2026-01-28 10:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2026-01-28 10:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2026-01-28 10:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695 to the API
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UV47695>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 162,
 'expiration_date': '2026-01-29T16:54:58Z',
 'fuel_type': 'petrol',
 'id': '3342bba9-2d13-5623-9104-beb227bf1fe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV47695',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'MG',
 'model': 'HS',
 'odometer': 57051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG HS 1.5 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2026-01-28 10:01:11 [auto1.it] INFO: Saving data for UV47695: {'auction_closing_time': 1769705698.0, 'created_time': 1768298739.444307, 'last_price_update_time': 1769594471.884301}
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV47695') HTTP/1.1" 204 0
2026-01-28 10:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3e63d0>
2026-01-28 10:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_b81c43423e588d086fcc29aef982f441.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_b81c43423e588d086fcc29aef982f441.jpg saved to cache
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_a8eecae58480f4b2f8595267deab9c92.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_a8eecae58480f4b2f8595267deab9c92.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_147931a2a06f95b9536b7262c18afd85.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_147931a2a06f95b9536b7262c18afd85.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_af57464badc9d85ce6a26de4bb913118.png%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_af57464badc9d85ce6a26de4bb913118.png not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_830f50be717f347a9e3a719b53898c9f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_830f50be717f347a9e3a719b53898c9f.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_95a6aba16497b1da52c773cca067c41b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_95a6aba16497b1da52c773cca067c41b.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_cb6ae5d19e40830399811c040723a31a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_cb6ae5d19e40830399811c040723a31a.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_183310933e510689807af65b166bdecd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_183310933e510689807af65b166bdecd.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg not downloaded yet
2026-01-28 10:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US18527> (referer: https://www.auto1.com/v1/car-details-view/US18527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG07242> (referer: https://www.auto1.com/v1/car-details-view/LG07242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg not downloaded yet
2026-01-28 10:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_84c4adf07c67fa9990c5d17719184d89.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_84c4adf07c67fa9990c5d17719184d89.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_500735aad672e93bdcd0325e5d2afe97.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_500735aad672e93bdcd0325e5d2afe97.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_a9197351fced3a8b43962e7dbc78091a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_a9197351fced3a8b43962e7dbc78091a.jpg not downloaded yet
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg not downloaded yet
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee578450>
2026-01-28 10:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg saved to cache
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg not downloaded yet
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_7e2095329a0a68c1079c83f51d83a105.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7e2095329a0a68c1079c83f51d83a105.jpg not downloaded yet
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_a8910888d62c179a7e636498afc50ff5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_a8910888d62c179a7e636498afc50ff5.jpg not downloaded yet
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_f34b408fab4f8be1424cfe0e8b226104.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_f34b408fab4f8be1424cfe0e8b226104.jpg not downloaded yet
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_da3ab9599920fceebca84d28f368eeae.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_da3ab9599920fceebca84d28f368eeae.jpg not downloaded yet
2026-01-28 10:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d23146f-30bf-5063-9522-41852f095b97 with identifier: US18527
2026-01-28 10:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d23146f-30bf-5063-9522-41852f095b97 with scrape type 1
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_374ad204e5a6f068e71aec6b0faab302.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_374ad204e5a6f068e71aec6b0faab302.jpg not downloaded yet
2026-01-28 10:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2026-01-28 10:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 614fbb5e-6d91-58e6-a433-14a9df641eb1 with scrape type 2
2026-01-28 10:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 614fbb5e-6d91-58e6-a433-14a9df641eb1 with scrape type 2
2026-01-28 10:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 614fbb5e-6d91-58e6-a433-14a9df641eb1, identifier: LG07242
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5751d0>
2026-01-28 10:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg saved to cache
2026-01-28 10:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_76e8b524fc926240389714c4b3290e2c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_2bcce0311b08624c179521850a4870f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_2bcce0311b08624c179521850a4870f7.jpg not downloaded yet
2026-01-28 10:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2026-01-28 10:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242
2026-01-28 10:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 614fbb5e-6d91-58e6-a433-14a9df641eb1 with identifier: LG07242 to the API
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG07242>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:03:50Z',
 'fuel_type': 'petrol',
 'id': '614fbb5e-6d91-58e6-a433-14a9df641eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG07242',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 88526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2026-01-28 10:01:14 [auto1.it] INFO: Saving data for LG07242: {'auction_closing_time': 1769702630.0, 'created_time': 1767866533.112673, 'last_price_update_time': 1769594474.879928}
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG07242') HTTP/1.1" 204 0
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_b6f8836441256283e6dba9c25a145681.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_b6f8836441256283e6dba9c25a145681.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_64b1d497feafe145d45c1d959076deac.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_64b1d497feafe145d45c1d959076deac.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_69f7439237450466e42803b0b09145a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_69f7439237450466e42803b0b09145a2.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_7d760a799351379919ef876315c9cbcf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_7d760a799351379919ef876315c9cbcf.jpg not downloaded yet
2026-01-28 10:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9a722e53db8d1a38885891184e20f3b4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_203df7875b2a26eb33fe00b48c85c810.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5207d0>
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_76e8b524fc926240389714c4b3290e2c.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_76e8b524fc926240389714c4b3290e2c.jpg saved to cache
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_4486c3309f97986e1d5219545cee8eb1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_4486c3309f97986e1d5219545cee8eb1.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_3a6ae645835adf0034684a298effb885.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_3a6ae645835adf0034684a298effb885.jpg not downloaded yet
2026-01-28 10:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_37f4fc21b569993812e411593690f69a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_37f4fc21b569993812e411593690f69a.jpg not downloaded yet
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_beda5a133815723b30069655a1ab1f61.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_beda5a133815723b30069655a1ab1f61.jpg not downloaded yet
2026-01-28 10:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefc2bd0>
2026-01-28 10:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_9a722e53db8d1a38885891184e20f3b4.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9a722e53db8d1a38885891184e20f3b4.jpg saved to cache
2026-01-28 10:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe0390>
2026-01-28 10:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_203df7875b2a26eb33fe00b48c85c810.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_203df7875b2a26eb33fe00b48c85c810.jpg saved to cache
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_2fea54ce2745587c1eadb16887a27ff0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg not downloaded yet
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_73c1aa617ee80d5a4913cc16013b9f76.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_73c1aa617ee80d5a4913cc16013b9f76.jpg not downloaded yet
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg not downloaded yet
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg not downloaded yet
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee34cad0>
2026-01-28 10:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg saved to cache
2026-01-28 10:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5eed90>
2026-01-28 10:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_2fea54ce2745587c1eadb16887a27ff0.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_2fea54ce2745587c1eadb16887a27ff0.jpg saved to cache
2026-01-28 10:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee522e50>
2026-01-28 10:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg saved to cache
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_f6eea11170118d3d466d4a308efcd756.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_f6eea11170118d3d466d4a308efcd756.jpg not downloaded yet
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg not downloaded yet
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9fefa346efdb01c4fd4189df1456fd22.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_0b095abfc0378ffffc1bc092ba678c49.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0b095abfc0378ffffc1bc092ba678c49.jpg not downloaded yet
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_805445061ce7693318a094f7188173da.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_5c2a1877165e911991b16710acff7ac1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_5c2a1877165e911991b16710acff7ac1.jpg not downloaded yet
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_3a964ace0577ee416034102e02f7a4aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_830f50be717f347a9e3a719b53898c9f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_af9b525df66a473e1d8318715152836a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_af9b525df66a473e1d8318715152836a.jpg not downloaded yet
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_6fea05b3df1d00074e381f2018ec591a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_6fea05b3df1d00074e381f2018ec591a.jpg not downloaded yet
2026-01-28 10:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4d6c90>
2026-01-28 10:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_9fefa346efdb01c4fd4189df1456fd22.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9fefa346efdb01c4fd4189df1456fd22.jpg saved to cache
2026-01-28 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5deb10>
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg saved to cache
2026-01-28 10:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee97b50>
2026-01-28 10:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg saved to cache
2026-01-28 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_e928a788181e1b8a14cb316db91c3182.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_e928a788181e1b8a14cb316db91c3182.jpg not downloaded yet
2026-01-28 10:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_64b1d497feafe145d45c1d959076deac.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3ee890>
2026-01-28 10:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_805445061ce7693318a094f7188173da.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_805445061ce7693318a094f7188173da.jpg saved to cache
2026-01-28 10:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee574c10>
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg saved to cache
2026-01-28 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4017d0>
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_3a964ace0577ee416034102e02f7a4aa.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_3a964ace0577ee416034102e02f7a4aa.jpg saved to cache
2026-01-28 10:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee34e390>
2026-01-28 10:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_830f50be717f347a9e3a719b53898c9f.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_830f50be717f347a9e3a719b53898c9f.jpg saved to cache
2026-01-28 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f5020b10>
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_64b1d497feafe145d45c1d959076deac.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_64b1d497feafe145d45c1d959076deac.jpg saved to cache
2026-01-28 10:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_37f4fc21b569993812e411593690f69a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_95a6aba16497b1da52c773cca067c41b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee422890>
2026-01-28 10:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_37f4fc21b569993812e411593690f69a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_37f4fc21b569993812e411593690f69a.jpg saved to cache
2026-01-28 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_26aa518d477668b4363acf1ac221666c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee2090d0>
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_95a6aba16497b1da52c773cca067c41b.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_95a6aba16497b1da52c773cca067c41b.jpg saved to cache
2026-01-28 10:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404ee50>
2026-01-28 10:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_26aa518d477668b4363acf1ac221666c.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_26aa518d477668b4363acf1ac221666c.jpg saved to cache
2026-01-28 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_a8910888d62c179a7e636498afc50ff5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_beda5a133815723b30069655a1ab1f61.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_3a6ae645835adf0034684a298effb885.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_6fea05b3df1d00074e381f2018ec591a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_af9b525df66a473e1d8318715152836a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_f6eea11170118d3d466d4a308efcd756.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4064750>
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_a8910888d62c179a7e636498afc50ff5.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_a8910888d62c179a7e636498afc50ff5.jpg saved to cache
2026-01-28 10:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee329410>
2026-01-28 10:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg saved to cache
2026-01-28 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_e928a788181e1b8a14cb316db91c3182.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_4486c3309f97986e1d5219545cee8eb1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3da990>
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_beda5a133815723b30069655a1ab1f61.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_beda5a133815723b30069655a1ab1f61.jpg saved to cache
2026-01-28 10:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee523250>
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_3a6ae645835adf0034684a298effb885.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_3a6ae645835adf0034684a298effb885.jpg saved to cache
2026-01-28 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d7490>
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_6fea05b3df1d00074e381f2018ec591a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_6fea05b3df1d00074e381f2018ec591a.jpg saved to cache
2026-01-28 10:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3eea10>
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_af9b525df66a473e1d8318715152836a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_af9b525df66a473e1d8318715152836a.jpg saved to cache
2026-01-28 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee331290>
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg saved to cache
2026-01-28 10:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefaab50>
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_f6eea11170118d3d466d4a308efcd756.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_f6eea11170118d3d466d4a308efcd756.jpg saved to cache
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d4390>
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg saved to cache
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3db410>
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg saved to cache
2026-01-28 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeea4850>
2026-01-28 10:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg saved to cache
2026-01-28 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40e6f90>
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_e928a788181e1b8a14cb316db91c3182.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_e928a788181e1b8a14cb316db91c3182.jpg saved to cache
2026-01-28 10:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeea7b10>
2026-01-28 10:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_4486c3309f97986e1d5219545cee8eb1.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_4486c3309f97986e1d5219545cee8eb1.jpg saved to cache
2026-01-28 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0b095abfc0378ffffc1bc092ba678c49.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_69f7439237450466e42803b0b09145a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_5c2a1877165e911991b16710acff7ac1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_b6f8836441256283e6dba9c25a145681.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_73c1aa617ee80d5a4913cc16013b9f76.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_2bcce0311b08624c179521850a4870f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f5118490>
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_0b095abfc0378ffffc1bc092ba678c49.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0b095abfc0378ffffc1bc092ba678c49.jpg saved to cache
2026-01-28 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_f34b408fab4f8be1424cfe0e8b226104.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_da3ab9599920fceebca84d28f368eeae.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7e2095329a0a68c1079c83f51d83a105.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3b5010>
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg saved to cache
2026-01-28 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3a6790>
2026-01-28 10:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_69f7439237450466e42803b0b09145a2.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_69f7439237450466e42803b0b09145a2.jpg saved to cache
2026-01-28 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe65d0>
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_5c2a1877165e911991b16710acff7ac1.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_5c2a1877165e911991b16710acff7ac1.jpg saved to cache
2026-01-28 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5c4bd0>
2026-01-28 10:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg saved to cache
2026-01-28 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f50377d0>
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_b6f8836441256283e6dba9c25a145681.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_b6f8836441256283e6dba9c25a145681.jpg saved to cache
2026-01-28 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4227a90>
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_73c1aa617ee80d5a4913cc16013b9f76.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_73c1aa617ee80d5a4913cc16013b9f76.jpg saved to cache
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f412b210>
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_2bcce0311b08624c179521850a4870f7.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_2bcce0311b08624c179521850a4870f7.jpg saved to cache
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_a9197351fced3a8b43962e7dbc78091a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeeac090>
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_f34b408fab4f8be1424cfe0e8b226104.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_f34b408fab4f8be1424cfe0e8b226104.jpg saved to cache
2026-01-28 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee35cc10>
2026-01-28 10:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_da3ab9599920fceebca84d28f368eeae.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_da3ab9599920fceebca84d28f368eeae.jpg saved to cache
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_500735aad672e93bdcd0325e5d2afe97.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5c5750>
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_7e2095329a0a68c1079c83f51d83a105.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7e2095329a0a68c1079c83f51d83a105.jpg saved to cache
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3a5810>
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg saved to cache
2026-01-28 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee54d2d0>
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg saved to cache
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefd4350>
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg saved to cache
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee373490>
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_a9197351fced3a8b43962e7dbc78091a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_a9197351fced3a8b43962e7dbc78091a.jpg saved to cache
2026-01-28 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee342d50>
2026-01-28 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_500735aad672e93bdcd0325e5d2afe97.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_500735aad672e93bdcd0325e5d2afe97.jpg saved to cache
2026-01-28 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_7d760a799351379919ef876315c9cbcf.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_374ad204e5a6f068e71aec6b0faab302.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_cb6ae5d19e40830399811c040723a31a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_84c4adf07c67fa9990c5d17719184d89.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_183310933e510689807af65b166bdecd.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ca41da94f5ec40e30277b7df816212f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_147931a2a06f95b9536b7262c18afd85.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_af57464badc9d85ce6a26de4bb913118.png> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40d55d0>
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg saved to cache
2026-01-28 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_17da5de46c42b028ea74421e73854842.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8090f228d8977472393ad80d203777b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_a8eecae58480f4b2f8595267deab9c92.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png> (referer: https://www.auto1.com/)
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5e9a10>
2026-01-28 10:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_7d760a799351379919ef876315c9cbcf.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_7d760a799351379919ef876315c9cbcf.jpg saved to cache
2026-01-28 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4e2dd0>
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F80%252F47809b3ecb95aac21fd3d60a8dc58ee8%252Fpa%252FUS18527_374ad204e5a6f068e71aec6b0faab302.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_374ad204e5a6f068e71aec6b0faab302.jpg saved to cache
2026-01-28 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d23146f-30bf-5063-9522-41852f095b97
2026-01-28 10:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d23146f-30bf-5063-9522-41852f095b97, skipping ID generation
2026-01-28 10:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d23146f-30bf-5063-9522-41852f095b97 with scrape type 1
2026-01-28 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2d23146f-30bf-5063-9522-41852f095b97 from tracking dictionaries
2026-01-28 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d23146f-30bf-5063-9522-41852f095b97 sending to next pipeline
2026-01-28 10:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d23146f-30bf-5063-9522-41852f095b97, identifier: US18527
2026-01-28 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40d72d0>
2026-01-28 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_cb6ae5d19e40830399811c040723a31a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_cb6ae5d19e40830399811c040723a31a.jpg saved to cache
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d7b50>
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg saved to cache
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee330a90>
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_84c4adf07c67fa9990c5d17719184d89.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_84c4adf07c67fa9990c5d17719184d89.jpg saved to cache
2026-01-28 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef64b50>
2026-01-28 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_183310933e510689807af65b166bdecd.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_183310933e510689807af65b166bdecd.jpg saved to cache
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefbc050>
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F31%252Fa331f03f6d1e17086d63478a5a2894bc%252Fpa%252FYR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg saved to cache
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b54c372-4263-5683-aaaf-64269cdcee90
2026-01-28 10:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b54c372-4263-5683-aaaf-64269cdcee90, skipping ID generation
2026-01-28 10:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b54c372-4263-5683-aaaf-64269cdcee90 with scrape type 1
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8b54c372-4263-5683-aaaf-64269cdcee90 from tracking dictionaries
2026-01-28 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b54c372-4263-5683-aaaf-64269cdcee90 sending to next pipeline
2026-01-28 10:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b54c372-4263-5683-aaaf-64269cdcee90, identifier: YR64297
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee52afd0>
2026-01-28 10:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_ca41da94f5ec40e30277b7df816212f2.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ca41da94f5ec40e30277b7df816212f2.jpg saved to cache
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f53f99d0>
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_147931a2a06f95b9536b7262c18afd85.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_147931a2a06f95b9536b7262c18afd85.jpg saved to cache
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 10:01:45 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 10:01:45 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 10:01:45 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f410ccd0>
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_14.png HTTP/1.1" 201 0
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_af57464badc9d85ce6a26de4bb913118.png') HTTP/1.1" 204 0
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_af57464badc9d85ce6a26de4bb913118.png saved to cache
2026-01-28 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d23146f-30bf-5063-9522-41852f095b97 with identifier: US18527
2026-01-28 10:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d23146f-30bf-5063-9522-41852f095b97 with identifier: US18527
2026-01-28 10:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d23146f-30bf-5063-9522-41852f095b97 with identifier: US18527 to the API
2026-01-28 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_374ad204e5a6f068e71aec6b0faab302.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:09:49Z',
 'fuel_type': 'diesel',
 'id': '2d23146f-30bf-5063-9522-41852f095b97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US18527',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 148276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5116716,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_374ad204e5a6f068e71aec6b0faab302.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5116716,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_a295c3a9a9df3ae9257f663a8c40fd0e.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5429269,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_7d760a799351379919ef876315c9cbcf.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928080,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_3a6ae645835adf0034684a298effb885.jpg',
             'Width': 2629},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928080,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_beda5a133815723b30069655a1ab1f61.jpg',
             'Width': 2629},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3208083,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_73c1aa617ee80d5a4913cc16013b9f76.jpg',
             'Width': 3021},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5116716,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0a8f3bd5b7ff5b40ffbd59ec9b1a9150.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4635838,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_8026903b2898e6b4ff9236ddb4d5a0a6.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4141784,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_0b095abfc0378ffffc1bc092ba678c49.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2798341,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_5c2a1877165e911991b16710acff7ac1.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3587744,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_af9b525df66a473e1d8318715152836a.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3766101,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_6fea05b3df1d00074e381f2018ec591a.jpg',
             'Width': 4080},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d23146f-30bf-5063-9522-41852f095b97/2d23146f-30bf-5063-9522-41852f095b97_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3156660,
             'Height': 3060,
             'OriginUrl': 'https://img-pa.auto1.com/img47/80/47809b3ecb95aac21fd3d60a8dc58ee8/pa/US18527_e928a788181e1b8a14cb316db91c3182.jpg',
             'Width': 4080}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US18527%27 HTTP/1.1" 200 None
2026-01-28 10:01:46 [auto1.it] INFO: Saving data for US18527: {'created_time': 1769594506.356228, 'last_price_update_time': 1769594506.356244, 'auction_closing_time': 1769702989.0}
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US18527') HTTP/1.1" 204 0
2026-01-28 10:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b54c372-4263-5683-aaaf-64269cdcee90 with identifier: YR64297
2026-01-28 10:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b54c372-4263-5683-aaaf-64269cdcee90 with identifier: YR64297
2026-01-28 10:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b54c372-4263-5683-aaaf-64269cdcee90 with identifier: YR64297 to the API
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:10:24Z',
 'fuel_type': 'diesel',
 'id': '8b54c372-4263-5683-aaaf-64269cdcee90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR64297',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 118903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132919,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_26f0a98c90ce1c6a5b3bcc51c4370e18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132919,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7d4555dc9cbd77af676e28b91bdcc4c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 150236,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_cf9f49048899bc3b0e3d46797d7aee11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130630,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_a9197351fced3a8b43962e7dbc78091a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137546,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_7e2095329a0a68c1079c83f51d83a105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134013,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_da3ab9599920fceebca84d28f368eeae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135127,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_64b1d497feafe145d45c1d959076deac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204407,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_69f7439237450466e42803b0b09145a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122830,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_4486c3309f97986e1d5219545cee8eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112718,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_37f4fc21b569993812e411593690f69a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123749,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_05f89f4a5ea2166f0aef6c2c06878ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84477,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_84d1475d0d64b8206ab3f431baed9d3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b54c372-4263-5683-aaaf-64269cdcee90/8b54c372-4263-5683-aaaf-64269cdcee90_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103534,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/31/a331f03f6d1e17086d63478a5a2894bc/pa/YR64297_f6eea11170118d3d466d4a308efcd756.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR64297%27 HTTP/1.1" 200 None
2026-01-28 10:01:46 [auto1.it] INFO: Saving data for YR64297: {'created_time': 1769594506.829215, 'last_price_update_time': 1769594506.829228, 'auction_closing_time': 1769703024.0}
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR64297') HTTP/1.1" 204 0
2026-01-28 10:01:46 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 53 pages/min), scraped 8 items (at 8 items/min)
2026-01-28 10:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee534310>
2026-01-28 10:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_17da5de46c42b028ea74421e73854842.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_17da5de46c42b028ea74421e73854842.jpg saved to cache
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404ae50>
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_8090f228d8977472393ad80d203777b5.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8090f228d8977472393ad80d203777b5.jpg saved to cache
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee32d390>
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_a8eecae58480f4b2f8595267deab9c92.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_a8eecae58480f4b2f8595267deab9c92.jpg saved to cache
2026-01-28 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 10:01:47 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 10:01:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 10:01:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee46fa10>
2026-01-28 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_13.png HTTP/1.1" 201 0
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png') HTTP/1.1" 204 0
2026-01-28 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png saved to cache
2026-01-28 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_67bcde26e46c2a4acf973d073273f46f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_d6f945e2370aabef4a94f5304110fa6a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_805b74b18e2bca082b2686a00ecb5447.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_02fc7228f15398d063a8e7aa0640f57e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_840de5b8f7408052b869a94d1b17973b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_c6073e78f47607e025e18fd03aea5034.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe3790>
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_67bcde26e46c2a4acf973d073273f46f.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_67bcde26e46c2a4acf973d073273f46f.jpg saved to cache
2026-01-28 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_fffa17c32680744cbe1f22dff78060e0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_418ba7996392db75e755f49d6020b1a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee54fad0>
2026-01-28 10:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg saved to cache
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeee4650>
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_d6f945e2370aabef4a94f5304110fa6a.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_d6f945e2370aabef4a94f5304110fa6a.jpg saved to cache
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefd44d0>
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_805b74b18e2bca082b2686a00ecb5447.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_805b74b18e2bca082b2686a00ecb5447.jpg saved to cache
2026-01-28 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee54ec90>
2026-01-28 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg saved to cache
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefd6c50>
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg saved to cache
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4eeb3d0>
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_02fc7228f15398d063a8e7aa0640f57e.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_02fc7228f15398d063a8e7aa0640f57e.jpg saved to cache
2026-01-28 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefc1e50>
2026-01-28 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_840de5b8f7408052b869a94d1b17973b.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_840de5b8f7408052b869a94d1b17973b.jpg saved to cache
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40c6a90>
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F56%252F2056643e3670a1dd469781db0bb8ffc7%252Fpa%252FTU81293_c6073e78f47607e025e18fd03aea5034.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_c6073e78f47607e025e18fd03aea5034.jpg saved to cache
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab
2026-01-28 10:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1a1bb99-dd3f-5e10-b62d-29f076b572ab, skipping ID generation
2026-01-28 10:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab with scrape type 1
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1a1bb99-dd3f-5e10-b62d-29f076b572ab from tracking dictionaries
2026-01-28 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1a1bb99-dd3f-5e10-b62d-29f076b572ab sending to next pipeline
2026-01-28 10:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e1a1bb99-dd3f-5e10-b62d-29f076b572ab, identifier: TU81293
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3b5a90>
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg saved to cache
2026-01-28 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_07fb632afae2f4488c461e07bebbb1ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e1a1bb99-dd3f-5e10-b62d-29f076b572ab with identifier: TU81293
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-28 10:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e1a1bb99-dd3f-5e10-b62d-29f076b572ab with identifier: TU81293
2026-01-28 10:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e1a1bb99-dd3f-5e10-b62d-29f076b572ab with identifier: TU81293 to the API
2026-01-28 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_c6073e78f47607e025e18fd03aea5034.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:47:56Z',
 'fuel_type': 'hybrid',
 'id': 'e1a1bb99-dd3f-5e10-b62d-29f076b572ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU81293',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 106965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_c6073e78f47607e025e18fd03aea5034.jpg',
             'Width': 785},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_e57677158b7302eabaf1d17cd3c9fdf4.jpg',
             'Width': 785},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_02fc7228f15398d063a8e7aa0640f57e.jpg',
             'Width': 732},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_17da5de46c42b028ea74421e73854842.jpg',
             'Width': 763},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_147931a2a06f95b9536b7262c18afd85.jpg',
             'Width': 744},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_183310933e510689807af65b166bdecd.jpg',
             'Width': 776},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_500735aad672e93bdcd0325e5d2afe97.jpg',
             'Width': 623},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_7f6f6ddee25eeffb98a11e2162ff7969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_f34b408fab4f8be1424cfe0e8b226104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_b6f8836441256283e6dba9c25a145681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_07018bb76c51caeaf413c6ffd8ce197f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_1eae2f1930cb1c455f607f00ce054b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1a1bb99-dd3f-5e10-b62d-29f076b572ab/e1a1bb99-dd3f-5e10-b62d-29f076b572ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/56/2056643e3670a1dd469781db0bb8ffc7/pa/TU81293_a5aaa549e8bc4837caed5b2637f205f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2022}
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU81293%27 HTTP/1.1" 200 None
2026-01-28 10:01:53 [auto1.it] INFO: Saving data for TU81293: {'created_time': 1769594513.297732, 'last_price_update_time': 1769594513.297744, 'auction_closing_time': 1769705276.0}
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU81293') HTTP/1.1" 204 0
2026-01-28 10:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_41c18f01c02f896a674a508727ac9deb.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_0675f976ad60c3cffbbcdaf84243537b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefcdd10>
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_fffa17c32680744cbe1f22dff78060e0.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_fffa17c32680744cbe1f22dff78060e0.jpg saved to cache
2026-01-28 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef71f10>
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_418ba7996392db75e755f49d6020b1a8.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_418ba7996392db75e755f49d6020b1a8.jpg saved to cache
2026-01-28 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee411e50>
2026-01-28 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg saved to cache
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_3b8f531cf585eda37a2c54c69159cf11.png> (referer: https://www.auto1.com/)
2026-01-28 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_9b27baa1678ed24b16c7df023a763c0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_890c925c5f088163597b3228e53cd3f9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee33a3d0>
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_07fb632afae2f4488c461e07bebbb1ac.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_07fb632afae2f4488c461e07bebbb1ac.jpg saved to cache
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_d62767dabbde536ee88933f3416e73ad.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee413690>
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_41c18f01c02f896a674a508727ac9deb.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_41c18f01c02f896a674a508727ac9deb.jpg saved to cache
2026-01-28 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4e86bd0>
2026-01-28 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_0675f976ad60c3cffbbcdaf84243537b.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_0675f976ad60c3cffbbcdaf84243537b.jpg saved to cache
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:55 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 10:01:55 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 10:01:55 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404c1d0>
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_11.png HTTP/1.1" 201 0
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_3b8f531cf585eda37a2c54c69159cf11.png') HTTP/1.1" 204 0
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_3b8f531cf585eda37a2c54c69159cf11.png saved to cache
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe45d0>
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_9b27baa1678ed24b16c7df023a763c0e.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_9b27baa1678ed24b16c7df023a763c0e.jpg saved to cache
2026-01-28 10:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f409e350>
2026-01-28 10:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_890c925c5f088163597b3228e53cd3f9.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_890c925c5f088163597b3228e53cd3f9.jpg saved to cache
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_cd245740c270c701a7a0c6867f987f25.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef7f250>
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg saved to cache
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe9090>
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_d62767dabbde536ee88933f3416e73ad.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_d62767dabbde536ee88933f3416e73ad.jpg saved to cache
2026-01-28 10:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_04cb0897b290f6f934639983e4600ccc.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_abb6a2e1130ed262f989002a6f303488.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3edf10>
2026-01-28 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg saved to cache
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee545690>
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_cd245740c270c701a7a0c6867f987f25.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_cd245740c270c701a7a0c6867f987f25.jpg saved to cache
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee57a650>
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg saved to cache
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_15ab064a4dbe38e52209a76f46b0a370.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_24d340a107602c4aea98456c3264efed.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3c3b10>
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_04cb0897b290f6f934639983e4600ccc.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_04cb0897b290f6f934639983e4600ccc.jpg saved to cache
2026-01-28 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f413aa90>
2026-01-28 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_abb6a2e1130ed262f989002a6f303488.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_abb6a2e1130ed262f989002a6f303488.jpg saved to cache
2026-01-28 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_72f77496a55d0252539c31e3c81b0fed.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40e67d0>
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_15ab064a4dbe38e52209a76f46b0a370.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_15ab064a4dbe38e52209a76f46b0a370.jpg saved to cache
2026-01-28 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f410cb50>
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg saved to cache
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee538b50>
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_24d340a107602c4aea98456c3264efed.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_24d340a107602c4aea98456c3264efed.jpg saved to cache
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5d3b90>
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg saved to cache
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8b913833db999edc1a950c3c34354a8c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_b4756dcfbdba62d34a90b4625f858f45.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee348dd0>
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_72f77496a55d0252539c31e3c81b0fed.jpg') HTTP/1.1" 204 0
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_72f77496a55d0252539c31e3c81b0fed.jpg saved to cache
2026-01-28 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee553490>
2026-01-28 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg saved to cache
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_058b3e3516e68492479d7369645ea0fe.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee33a810>
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_8b913833db999edc1a950c3c34354a8c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8b913833db999edc1a950c3c34354a8c.jpg saved to cache
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee341910>
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F91%252F4391088d444a75397f46cf64814a3cd6%252Fpa%252FWP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg saved to cache
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 435f0d34-da7f-592c-bfb8-c498ddc3016f
2026-01-28 10:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 435f0d34-da7f-592c-bfb8-c498ddc3016f, skipping ID generation
2026-01-28 10:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435f0d34-da7f-592c-bfb8-c498ddc3016f with scrape type 1
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 435f0d34-da7f-592c-bfb8-c498ddc3016f from tracking dictionaries
2026-01-28 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 435f0d34-da7f-592c-bfb8-c498ddc3016f sending to next pipeline
2026-01-28 10:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 435f0d34-da7f-592c-bfb8-c498ddc3016f, identifier: WP79549
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee51e710>
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_b4756dcfbdba62d34a90b4625f858f45.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_b4756dcfbdba62d34a90b4625f858f45.jpg saved to cache
2026-01-28 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4101f10>
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg saved to cache
2026-01-28 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 435f0d34-da7f-592c-bfb8-c498ddc3016f with identifier: WP79549
2026-01-28 10:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 435f0d34-da7f-592c-bfb8-c498ddc3016f with identifier: WP79549
2026-01-28 10:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157209 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157209
2026-01-28 10:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 435f0d34-da7f-592c-bfb8-c498ddc3016f spider: auto1.it
2026-01-28 10:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 435f0d34-da7f-592c-bfb8-c498ddc3016f due to rule: high_mileage_for_country.json, error: 157209 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157209
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:16:41Z',
 'fuel_type': 'diesel',
 'id': '435f0d34-da7f-592c-bfb8-c498ddc3016f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP79549',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 157209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_5c3df67ccc6f58c9ca2f1fa431ebcb03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_24d340a107602c4aea98456c3264efed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_043287bf87bc60f0d376ae5b1e73c3df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_76e8b524fc926240389714c4b3290e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_9b27baa1678ed24b16c7df023a763c0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_418ba7996392db75e755f49d6020b1a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2311608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_26aa518d477668b4363acf1ac221666c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_abb6a2e1130ed262f989002a6f303488.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ce9926f9811bdf86c2f3007f802d6cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_ca41da94f5ec40e30277b7df816212f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_95a6aba16497b1da52c773cca067c41b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_fd3b0eb6bfb0a52c6e1316d60599db2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_0fc0769ebb95a09f6fe36e20498fb32b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_a8910888d62c179a7e636498afc50ff5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_435f0d34-da7f-592c-bfb8-c498ddc3016f/435f0d34-da7f-592c-bfb8-c498ddc3016f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/91/4391088d444a75397f46cf64814a3cd6/pa/WP79549_2bcce0311b08624c179521850a4870f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2019}
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP79549%27 HTTP/1.1" 200 None
2026-01-28 10:02:02 [auto1.it] INFO: Saving data for WP79549: {'created_time': 1769594522.053974, 'last_price_update_time': 1769594522.053985, 'auction_closing_time': 1769703401.0}
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP79549') HTTP/1.1" 204 0
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_5e3168499973c9ba91a315390130ab20.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ce1c4b48da79b1a197a020b6090e63af.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d230c0af50e149480371d1903e8bf802.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefd8ed0>
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_058b3e3516e68492479d7369645ea0fe.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_058b3e3516e68492479d7369645ea0fe.jpg saved to cache
2026-01-28 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee545910>
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg saved to cache
2026-01-28 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee152d0>
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg saved to cache
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee362ad0>
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg saved to cache
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeff9e90>
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_5e3168499973c9ba91a315390130ab20.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_5e3168499973c9ba91a315390130ab20.jpg saved to cache
2026-01-28 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4065d90>
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg saved to cache
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee12b50>
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_ce1c4b48da79b1a197a020b6090e63af.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ce1c4b48da79b1a197a020b6090e63af.jpg saved to cache
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee34f3d0>
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F07%252F580705b31d9bb308ab31a4952825bf45%252Fpa%252FVP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg saved to cache
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9e2179f-40df-578f-9a2e-8062f76dfbeb
2026-01-28 10:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9e2179f-40df-578f-9a2e-8062f76dfbeb, skipping ID generation
2026-01-28 10:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e2179f-40df-578f-9a2e-8062f76dfbeb with scrape type 1
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9e2179f-40df-578f-9a2e-8062f76dfbeb from tracking dictionaries
2026-01-28 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9e2179f-40df-578f-9a2e-8062f76dfbeb sending to next pipeline
2026-01-28 10:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9e2179f-40df-578f-9a2e-8062f76dfbeb, identifier: VP15604
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40ac310>
2026-01-28 10:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_d230c0af50e149480371d1903e8bf802.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d230c0af50e149480371d1903e8bf802.jpg saved to cache
2026-01-28 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9e2179f-40df-578f-9a2e-8062f76dfbeb with identifier: VP15604
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-28 10:02:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9e2179f-40df-578f-9a2e-8062f76dfbeb with identifier: VP15604
2026-01-28 10:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9e2179f-40df-578f-9a2e-8062f76dfbeb with identifier: VP15604 to the API
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:02:49Z',
 'fuel_type': 'gas',
 'id': 'e9e2179f-40df-578f-9a2e-8062f76dfbeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP15604',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 126262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_1195e2cd1e8a834b9046bbadc03e09b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_d39bdb0f10ffcacaebe769882ba5ced7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_f3a6c1c57f5c9891c18484de0e5071b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8b913833db999edc1a950c3c34354a8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_b81c43423e588d086fcc29aef982f441.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_391ef484c4fc317d53fbfb5ce7d4360c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_42a8b863e41768d7805ffe826b1c4ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_203df7875b2a26eb33fe00b48c85c810.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_bc43adb1cc4ce5a80b99b192258415d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_2fbe34afc7f629f062cf20da0f6beef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_371ca6e94b320b9ef892cbdcb427a32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_8090f228d8977472393ad80d203777b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_a8eecae58480f4b2f8595267deab9c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_cb6ae5d19e40830399811c040723a31a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e2179f-40df-578f-9a2e-8062f76dfbeb/e9e2179f-40df-578f-9a2e-8062f76dfbeb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/07/580705b31d9bb308ab31a4952825bf45/pa/VP15604_84c4adf07c67fa9990c5d17719184d89.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Benzin / LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP15604%27 HTTP/1.1" 200 None
2026-01-28 10:02:05 [auto1.it] INFO: Saving data for VP15604: {'created_time': 1769594525.730767, 'last_price_update_time': 1769594525.73078, 'auction_closing_time': 1769702569.0}
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP15604') HTTP/1.1" 204 0
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_26a94fec62520ef4196d466359ca1f13.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_9ef948644a6e3c9806dfbd73da89780b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6de35f29d9575018974983fbef43be67.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_695dde3ac192fbabcdf9580d84dcf505.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_f515b8e8066286cc41abdb101078e6f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40c5790>
2026-01-28 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg saved to cache
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40e62d0>
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_26a94fec62520ef4196d466359ca1f13.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_26a94fec62520ef4196d466359ca1f13.jpg saved to cache
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee57eed0>
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg saved to cache
2026-01-28 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404d090>
2026-01-28 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Ffa%252F0bfab9f88842ee1413dd0ec805ef1dd7%252Fpa%252FGV70344_9ef948644a6e3c9806dfbd73da89780b.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_9ef948644a6e3c9806dfbd73da89780b.jpg saved to cache
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a
2026-01-28 10:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a, skipping ID generation
2026-01-28 10:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with scrape type 1
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a from tracking dictionaries
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 886e12d4-d60a-59d7-9c80-c28f8f2ec17a sending to next pipeline
2026-01-28 10:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a, identifier: GV70344
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeed3690>
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_6de35f29d9575018974983fbef43be67.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6de35f29d9575018974983fbef43be67.jpg saved to cache
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee344510>
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F90%252F4b90d57e6fd611760b6974c568c3698f%252Fpa%252FNX34632_695dde3ac192fbabcdf9580d84dcf505.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_695dde3ac192fbabcdf9580d84dcf505.jpg saved to cache
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab5ee693-55cf-527a-a182-d2284d05754f
2026-01-28 10:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab5ee693-55cf-527a-a182-d2284d05754f, skipping ID generation
2026-01-28 10:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5ee693-55cf-527a-a182-d2284d05754f with scrape type 1
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab5ee693-55cf-527a-a182-d2284d05754f from tracking dictionaries
2026-01-28 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab5ee693-55cf-527a-a182-d2284d05754f sending to next pipeline
2026-01-28 10:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab5ee693-55cf-527a-a182-d2284d05754f, identifier: NX34632
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3c0410>
2026-01-28 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_f515b8e8066286cc41abdb101078e6f3.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_f515b8e8066286cc41abdb101078e6f3.jpg saved to cache
2026-01-28 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with identifier: GV70344
2026-01-28 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with identifier: GV70344
2026-01-28 10:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 886e12d4-d60a-59d7-9c80-c28f8f2ec17a with identifier: GV70344 to the API
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_9ef948644a6e3c9806dfbd73da89780b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:53:33Z',
 'fuel_type': 'petrol',
 'id': '886e12d4-d60a-59d7-9c80-c28f8f2ec17a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV70344',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 20644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98270,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_9ef948644a6e3c9806dfbd73da89780b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98270,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d502cc8076c10b906ad7ddd41f2efb0c.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64962,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_d230c0af50e149480371d1903e8bf802.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70561,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ce1c4b48da79b1a197a020b6090e63af.jpg',
             'Width': 599},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77655,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_227b3ad8148d6b30830cc1d5570e7ea2.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102530,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_ebd25649f74b115ccf72b7dfaf0c3d1c.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88177,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_04cb0897b290f6f934639983e4600ccc.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68756,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_cd245740c270c701a7a0c6867f987f25.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32755,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_82f2ab85d76cb1e4d4c4c2149411a5c6.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60862,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_07fb632afae2f4488c461e07bebbb1ac.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65174,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_e1c84b419940285c1208bc6bc4fcf89d.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61689,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_840de5b8f7408052b869a94d1b17973b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_886e12d4-d60a-59d7-9c80-c28f8f2ec17a/886e12d4-d60a-59d7-9c80-c28f8f2ec17a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20102,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/fa/0bfab9f88842ee1413dd0ec805ef1dd7/pa/GV70344_805b74b18e2bca082b2686a00ecb5447.jpg',
             'Width': 361}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV70344%27 HTTP/1.1" 200 None
2026-01-28 10:02:08 [auto1.it] INFO: Saving data for GV70344: {'created_time': 1769594528.641471, 'last_price_update_time': 1769594528.641485, 'auction_closing_time': 1769705613.0}
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV70344') HTTP/1.1" 204 0
2026-01-28 10:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab5ee693-55cf-527a-a182-d2284d05754f with identifier: NX34632
2026-01-28 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab5ee693-55cf-527a-a182-d2284d05754f with identifier: NX34632
2026-01-28 10:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab5ee693-55cf-527a-a182-d2284d05754f with identifier: NX34632 to the API
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_695dde3ac192fbabcdf9580d84dcf505.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:17:53Z',
 'fuel_type': 'diesel',
 'id': 'ab5ee693-55cf-527a-a182-d2284d05754f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX34632',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 59446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41020,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_695dde3ac192fbabcdf9580d84dcf505.jpg',
             'Width': 581},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41020,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_26a94fec62520ef4196d466359ca1f13.jpg',
             'Width': 581},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43555,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_cf5f4001e1f5c730fe8a0d9b7b0c40d0.jpg',
             'Width': 562},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31845,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_ea1fc3d591e435395e56fafbd7d1d0a8.jpg',
             'Width': 501},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44150,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_7edbe7ea98a48236f992b3d67f029fdd.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48030,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_72f77496a55d0252539c31e3c81b0fed.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44588,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_15ab064a4dbe38e52209a76f46b0a370.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43319,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c8b262ec5b23f07514adde6df0cdc2b6.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21630,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_d62767dabbde536ee88933f3416e73ad.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32069,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_0675f976ad60c3cffbbcdaf84243537b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32765,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_fffa17c32680744cbe1f22dff78060e0.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_11.png',
             'Extension': 'png',
             'FileSizeInBytes': 707122,
             'Height': 535,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_3b8f531cf585eda37a2c54c69159cf11.png',
             'Width': 717},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24388,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_f1ba1138b47aad80974ce65e0dcc3dd3.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_13.png',
             'Extension': 'png',
             'FileSizeInBytes': 281725,
             'Height': 485,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_c724f11dcc1e5df390e9a0eb1b124a9a.png',
             'Width': 497},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5ee693-55cf-527a-a182-d2284d05754f/ab5ee693-55cf-527a-a182-d2284d05754f_image_14.png',
             'Extension': 'png',
             'FileSizeInBytes': 575127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/90/4b90d57e6fd611760b6974c568c3698f/pa/NX34632_af57464badc9d85ce6a26de4bb913118.png',
             'Width': 642}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Executive 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Executive 4Motion BlueMotion',
 'year': 2020}
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX34632%27 HTTP/1.1" 200 None
2026-01-28 10:02:09 [auto1.it] INFO: Saving data for NX34632: {'created_time': 1769594529.129782, 'last_price_update_time': 1769594529.129799, 'auction_closing_time': 1769703473.0}
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX34632') HTTP/1.1" 204 0
2026-01-28 10:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3459d0>
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg saved to cache
2026-01-28 10:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefd9e10>
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F29%252F7e29709a3fa1528e14e056e8348918b1%252Fpa%252FLV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg saved to cache
2026-01-28 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54cb7118-cc05-5fed-b651-d179f3b6ab53
2026-01-28 10:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54cb7118-cc05-5fed-b651-d179f3b6ab53, skipping ID generation
2026-01-28 10:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cb7118-cc05-5fed-b651-d179f3b6ab53 with scrape type 1
2026-01-28 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54cb7118-cc05-5fed-b651-d179f3b6ab53 from tracking dictionaries
2026-01-28 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54cb7118-cc05-5fed-b651-d179f3b6ab53 sending to next pipeline
2026-01-28 10:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54cb7118-cc05-5fed-b651-d179f3b6ab53, identifier: LV69875
2026-01-28 10:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54cb7118-cc05-5fed-b651-d179f3b6ab53 with identifier: LV69875
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-28 10:02:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54cb7118-cc05-5fed-b651-d179f3b6ab53 with identifier: LV69875
2026-01-28 10:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54cb7118-cc05-5fed-b651-d179f3b6ab53 with identifier: LV69875 to the API
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:59:02Z',
 'fuel_type': 'petrol',
 'id': '54cb7118-cc05-5fed-b651-d179f3b6ab53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV69875',
 'listing': 'auction',
 'location': 'IT, Palermo',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 71741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_f515b8e8066286cc41abdb101078e6f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6de35f29d9575018974983fbef43be67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_0408aa824e940ad2bcc99a40f86e36cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_5e3168499973c9ba91a315390130ab20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_b4756dcfbdba62d34a90b4625f858f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_c180e0ec2d2b328fcef9757dfdeb42b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2224968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_8c1c07b012021c9c8d70fc8de5a71173.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_444e5f0e7f1f3e455bed50f6b8822d13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_890c925c5f088163597b3228e53cd3f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_41c18f01c02f896a674a508727ac9deb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_058b3e3516e68492479d7369645ea0fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_6270e3fe2bdcdf1befb8a741f3e3ef36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_d6f945e2370aabef4a94f5304110fa6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_67bcde26e46c2a4acf973d073273f46f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54cb7118-cc05-5fed-b651-d179f3b6ab53/54cb7118-cc05-5fed-b651-d179f3b6ab53_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/29/7e29709a3fa1528e14e056e8348918b1/pa/LV69875_830f50be717f347a9e3a719b53898c9f.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV69875%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [auto1.it] INFO: Saving data for LV69875: {'created_time': 1769594531.015732, 'last_price_update_time': 1769594531.015743, 'auction_closing_time': 1769705942.0}
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV69875') HTTP/1.1" 204 0
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM48651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE03903> (referer: https://www.auto1.com/v1/car-details-view/RE03903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV42227> (referer: https://www.auto1.com/v1/car-details-view/UV42227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU45503> (referer: https://www.auto1.com/v1/car-details-view/UU45503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK01527> (referer: https://www.auto1.com/v1/car-details-view/CK01527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB37983> (referer: https://www.auto1.com/v1/car-details-view/LB37983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP25474> (referer: https://www.auto1.com/v1/car-details-view/KP25474/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_77934417c16c03d4cbe8f383f54ec48f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_6e80dbc423252d49e027de38b128348a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_fa37e016fcb362820eef795a33d7ff9f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6390e9e-f1bd-5c80-84bd-afadf07279a9 with identifier: RE03903
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6390e9e-f1bd-5c80-84bd-afadf07279a9 with scrape type 1
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_66987853574940c9acbca4efa79c5b20.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_66987853574940c9acbca4efa79c5b20.jpg not downloaded yet
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84849814-c697-581c-8f67-dc0e48c12982 with identifier: UV42227
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84849814-c697-581c-8f67-dc0e48c12982 with scrape type 1
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 84849814-c697-581c-8f67-dc0e48c12982
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg not downloaded yet
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dd88d52-3011-56c3-8f75-39da084dbf89 with identifier: UU45503
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dd88d52-3011-56c3-8f75-39da084dbf89 with scrape type 1
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7abe348fa463b697890cf983f408fb08.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7abe348fa463b697890cf983f408fb08.jpg not downloaded yet
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec7bc138-991e-540b-b159-18b4ef230252 with identifier: CK01527
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec7bc138-991e-540b-b159-18b4ef230252 with scrape type 1
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_9941ad7129c03610d1a7db53be4ac397.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9941ad7129c03610d1a7db53be4ac397.jpg not downloaded yet
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e865f06-6d50-5d09-933e-474d59efc181 with identifier: LB37983
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e865f06-6d50-5d09-933e-474d59efc181 with scrape type 1
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_929970e603c7d8b30b6ba7321577973b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_929970e603c7d8b30b6ba7321577973b.jpg not downloaded yet
2026-01-28 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with identifier: KP25474
2026-01-28 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with scrape type 2
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with scrape type 2
2026-01-28 10:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8, identifier: KP25474
2026-01-28 10:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with identifier: KP25474
2026-01-28 10:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with identifier: KP25474
2026-01-28 10:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8 with identifier: KP25474 to the API
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP25474>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:01:26Z',
 'fuel_type': 'diesel',
 'id': '2bfce4a8-5c0c-50b1-82d2-ab81fb2f9ca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP25474',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 86743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2019}
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP25474%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [auto1.it] INFO: Saving data for KP25474: {'auction_closing_time': 1769702486.0, 'created_time': 1768853164.658158, 'last_price_update_time': 1769594531.789348}
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KP25474') HTTP/1.1" 204 0
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg not downloaded yet
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_ed026bd42465ea368bbebcfe0116ca5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_ed026bd42465ea368bbebcfe0116ca5e.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_a1572dc45fa1de9c79dab032ea8f6815.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_a1572dc45fa1de9c79dab032ea8f6815.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_9d9b9301a27f0c14f3fbe3b542443cf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_9d9b9301a27f0c14f3fbe3b542443cf4.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_4d6b5790b3d2577c5b099974f7929252.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_4d6b5790b3d2577c5b099974f7929252.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_72830f8a810d99b301d8b554857f0060.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_72830f8a810d99b301d8b554857f0060.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_a5500a527fee46615fa2f0802ad5f920.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_a5500a527fee46615fa2f0802ad5f920.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_6772f50f0fa3b57af4870d7cff99bfc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_6772f50f0fa3b57af4870d7cff99bfc5.jpg already downloaded
2026-01-28 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_649eeb22747b0d304660bb5b91931dc8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_649eeb22747b0d304660bb5b91931dc8.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_559557a3fbbe67fb4ea705440436d52a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_559557a3fbbe67fb4ea705440436d52a.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_cd5eec482bbbd39672b09af5226be669.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_cd5eec482bbbd39672b09af5226be669.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_606a71dcfacac94aaf51e900514e8c74.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_606a71dcfacac94aaf51e900514e8c74.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_902c4dd89f1ccd0287d4e025ed902c28.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_902c4dd89f1ccd0287d4e025ed902c28.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_f72efc141af98671a019a9219a5b3735.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_f72efc141af98671a019a9219a5b3735.jpg already downloaded
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_50a3ef90f77fb86bf14ecc338628da37.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_50a3ef90f77fb86bf14ecc338628da37.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_52e63018857646f5dc47dba0a6155fbb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_52e63018857646f5dc47dba0a6155fbb.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_649a7760e84ac808eb17269d6d924ea1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_649a7760e84ac808eb17269d6d924ea1.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_9b1a2d36497734c7c89a3fc93e401613.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9b1a2d36497734c7c89a3fc93e401613.jpg not downloaded yet
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg not downloaded yet
2026-01-28 10:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef6ead0>
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_77934417c16c03d4cbe8f383f54ec48f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_77934417c16c03d4cbe8f383f54ec48f.jpg saved to cache
2026-01-28 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee15550>
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_6e80dbc423252d49e027de38b128348a.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_6e80dbc423252d49e027de38b128348a.jpg saved to cache
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4af1d0>
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_fa37e016fcb362820eef795a33d7ff9f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_fa37e016fcb362820eef795a33d7ff9f.jpg saved to cache
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f403c450>
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg saved to cache
2026-01-28 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee16810>
2026-01-28 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1c%252Ff71c64b33cb217164832676aed672975%252Fpa%252FJH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg saved to cache
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1526a0d-a716-58ce-ada1-3d333c78d1e8
2026-01-28 10:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1526a0d-a716-58ce-ada1-3d333c78d1e8, skipping ID generation
2026-01-28 10:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1526a0d-a716-58ce-ada1-3d333c78d1e8 with scrape type 1
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1526a0d-a716-58ce-ada1-3d333c78d1e8 from tracking dictionaries
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1526a0d-a716-58ce-ada1-3d333c78d1e8 sending to next pipeline
2026-01-28 10:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1526a0d-a716-58ce-ada1-3d333c78d1e8, identifier: JH70368
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_f0801ff085bcec01e289e6fc627afe05.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_f0801ff085bcec01e289e6fc627afe05.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_1118a84c979970324980109480956d38.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_1118a84c979970324980109480956d38.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_819885d43ddd8b81f96bd642b378da8a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_819885d43ddd8b81f96bd642b378da8a.jpg not downloaded yet
2026-01-28 10:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1526a0d-a716-58ce-ada1-3d333c78d1e8 with identifier: JH70368
2026-01-28 10:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1526a0d-a716-58ce-ada1-3d333c78d1e8 with identifier: JH70368
2026-01-28 10:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151578 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151578
2026-01-28 10:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a1526a0d-a716-58ce-ada1-3d333c78d1e8 spider: auto1.it
2026-01-28 10:02:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a1526a0d-a716-58ce-ada1-3d333c78d1e8 due to rule: high_mileage_for_country.json, error: 151578 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151578
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:19:21Z',
 'fuel_type': 'diesel',
 'id': 'a1526a0d-a716-58ce-ada1-3d333c78d1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH70368',
 'listing': 'auction',
 'location': 'IT, Vigevano',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 151578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718038,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_7eb379cdf9255b150ae5b8f2d5086eb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2856266,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_a36fef5db0b3fae3d1cfe019411ed42c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2828722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_031ee1ff7a90656fdb33ee69b027ba41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_77934417c16c03d4cbe8f383f54ec48f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_6e80dbc423252d49e027de38b128348a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_fa37e016fcb362820eef795a33d7ff9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_3a964ace0577ee416034102e02f7a4aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9fefa346efdb01c4fd4189df1456fd22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_67fe46c6f8439e6d4fd84bdaa85da3bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_805445061ce7693318a094f7188173da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_4083185e5f0f6c4b67a9f1e61bb6b2f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_2fea54ce2745587c1eadb16887a27ff0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_36499944b909c1d8bc2c4375cc14e8b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_9a722e53db8d1a38885891184e20f3b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1526a0d-a716-58ce-ada1-3d333c78d1e8/a1526a0d-a716-58ce-ada1-3d333c78d1e8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/1c/f71c64b33cb217164832676aed672975/pa/JH70368_c845b525660ed54db2ff890abf936252.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 B-Tech',
 'transmission': 'automatic',
 'trim': 'Q4 B-Tech',
 'year': 2019}
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [auto1.it] INFO: Saving data for JH70368: {'created_time': 1769594534.839484, 'last_price_update_time': 1769594534.839497, 'auction_closing_time': 1769703561.0}
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH70368') HTTP/1.1" 204 0
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_0505a67781aa81b9c3779d83d3487125.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_0505a67781aa81b9c3779d83d3487125.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_7e4509d056643946038377b502ebe365.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7e4509d056643946038377b502ebe365.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_61571c2ae3b651f403837afdd92ca593.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_61571c2ae3b651f403837afdd92ca593.jpg not downloaded yet
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_935b5320d203249400b747f8b9cb1eb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_935b5320d203249400b747f8b9cb1eb0.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg not downloaded yet
2026-01-28 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_63348f9fb6e63997859057413b67cdab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_63348f9fb6e63997859057413b67cdab.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_37a5419ead8d8f3e5069341c35b66e12.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_37a5419ead8d8f3e5069341c35b66e12.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_61568a1439d8cd22225b3f96578b3ec9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_61568a1439d8cd22225b3f96578b3ec9.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_ef9455dc05b74eb361745e004a2ca583.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_ef9455dc05b74eb361745e004a2ca583.jpg not downloaded yet
2026-01-28 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_1118a84c979970324980109480956d38.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_4a4056f1a1af05a775648757872ec4c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_4a4056f1a1af05a775648757872ec4c9.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_f1473793509d02e8dcf4877dd76514f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_f1473793509d02e8dcf4877dd76514f2.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_95dae2f1ba195d951a45c32aa00dab55.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_95dae2f1ba195d951a45c32aa00dab55.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_98c1cd760946c9a682432d3788c44b36.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_98c1cd760946c9a682432d3788c44b36.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_d4fc962297c706cdd20f35c414d7340b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_d4fc962297c706cdd20f35c414d7340b.jpg not downloaded yet
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4e5ead0>
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg saved to cache
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe23d0>
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_1118a84c979970324980109480956d38.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_1118a84c979970324980109480956d38.jpg saved to cache
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_a684a039261b225ed31717f0e21a0f0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_a684a039261b225ed31717f0e21a0f0b.jpg not downloaded yet
2026-01-28 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_da8988b7b88e64659cc72b9e695427f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_da8988b7b88e64659cc72b9e695427f9.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_0a828df5beead0040b9eb27a1467c9de.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_0a828df5beead0040b9eb27a1467c9de.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_4f4a727eae18304230286294e3b2a298.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_4f4a727eae18304230286294e3b2a298.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_a36cdc1df4a937b505e5df62701d33cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_a36cdc1df4a937b505e5df62701d33cc.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_69ef35dbe28061fa9f7f2f17993f41e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_69ef35dbe28061fa9f7f2f17993f41e2.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_cc11ca629855ac91de54efb851e96b96.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_cc11ca629855ac91de54efb851e96b96.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_5d4c5fe138e6fa29bdd1a90e24183a4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_5d4c5fe138e6fa29bdd1a90e24183a4d.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_24db84110b8b47a8685e49900fbddc40.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_24db84110b8b47a8685e49900fbddc40.jpg already downloaded
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA09787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS60698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA63889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV22132> (referer: https://www.auto1.com/v1/car-details-view/NV22132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX23576> (referer: https://www.auto1.com/v1/car-details-view/KX23576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY00281> (referer: https://www.auto1.com/v1/car-details-view/YY00281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7b09231518d32f8efd2ced222c63efd0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7b09231518d32f8efd2ced222c63efd0.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_0032fc7efd7a97dc3186fea96c45660f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_0032fc7efd7a97dc3186fea96c45660f.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_09427b807b455e072994ec72b6076c91.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_09427b807b455e072994ec72b6076c91.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_64020a25c8368d24d18bf5f81211ddc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_64020a25c8368d24d18bf5f81211ddc0.jpg not downloaded yet
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_4f4a727eae18304230286294e3b2a298.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_6f95786297e88dca9dc39e2174b84be1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_6f95786297e88dca9dc39e2174b84be1.jpg not downloaded yet
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg not downloaded yet
2026-01-28 10:02:16 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 887b29f9-4597-5f8e-85e4-2b1733e87485 with identifier: NV22132
2026-01-28 10:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 887b29f9-4597-5f8e-85e4-2b1733e87485 with scrape type 1
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 887b29f9-4597-5f8e-85e4-2b1733e87485
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_56d7dbe424306d4fccee8c3c8bb0a6a4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_56d7dbe424306d4fccee8c3c8bb0a6a4.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_fce14a703f462385175b47a88ae2f4eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_fce14a703f462385175b47a88ae2f4eb.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_f81a4ceaf539749cf4996202bde2a898.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_f81a4ceaf539749cf4996202bde2a898.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_23a0131536c055af8335142656d62545.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_23a0131536c055af8335142656d62545.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_46f0400d41c3aaf2e1ee98d72186feb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_46f0400d41c3aaf2e1ee98d72186feb4.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_80dbc712db39821fbc54f6cca965a3fd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_80dbc712db39821fbc54f6cca965a3fd.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_860906bf9bdf68e0461161df8dcf5435.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_860906bf9bdf68e0461161df8dcf5435.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_ce7bc591fb27c87a53cdba07a376e9fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_ce7bc591fb27c87a53cdba07a376e9fb.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_3fbfa96ee3622911dd95ed6ebac8119c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3fbfa96ee3622911dd95ed6ebac8119c.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_8be83deb815ca12f4c76872cd23872f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8be83deb815ca12f4c76872cd23872f8.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_4b5246a49f35494e234c60830205bd20.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_4b5246a49f35494e234c60830205bd20.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_8551f03173d5ebef5aeac489b5c42863.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8551f03173d5ebef5aeac489b5c42863.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_20205f769484ba6b7190125b25faaa05.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_20205f769484ba6b7190125b25faaa05.jpg already downloaded
2026-01-28 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_d6df23203500769135c4aa618ed253d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_d6df23203500769135c4aa618ed253d0.jpg already downloaded
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F4d%252Fae4dc8a602fe73d73896b2de76b72e40%252Fpa%252FNV22132_3d2f5d13caefe3ee80d0e00a5e7671b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3d2f5d13caefe3ee80d0e00a5e7671b0.jpg already downloaded
2026-01-28 10:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 887b29f9-4597-5f8e-85e4-2b1733e87485, identifier: NV22132
2026-01-28 10:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20195a17-87c8-573e-b804-28bdd704227f with identifier: KX23576
2026-01-28 10:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20195a17-87c8-573e-b804-28bdd704227f with scrape type 1
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg not downloaded yet
2026-01-28 10:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-01-28 10:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc51c1c-487a-5916-8b01-97da479b74ce with scrape type 1
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg not downloaded yet
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg not downloaded yet
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7ebaca697da72898e13b1e887bfe4483.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7ebaca697da72898e13b1e887bfe4483.jpg not downloaded yet
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg not downloaded yet
2026-01-28 10:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 887b29f9-4597-5f8e-85e4-2b1733e87485 with identifier: NV22132
2026-01-28 10:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 887b29f9-4597-5f8e-85e4-2b1733e87485 with identifier: NV22132
2026-01-28 10:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 887b29f9-4597-5f8e-85e4-2b1733e87485 with identifier: NV22132 to the API
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV22132>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:36:54Z',
 'fuel_type': 'diesel',
 'id': '887b29f9-4597-5f8e-85e4-2b1733e87485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV22132',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 91158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_56d7dbe424306d4fccee8c3c8bb0a6a4.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_fce14a703f462385175b47a88ae2f4eb.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_f81a4ceaf539749cf4996202bde2a898.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_23a0131536c055af8335142656d62545.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_46f0400d41c3aaf2e1ee98d72186feb4.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_80dbc712db39821fbc54f6cca965a3fd.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_860906bf9bdf68e0461161df8dcf5435.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_ce7bc591fb27c87a53cdba07a376e9fb.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3fbfa96ee3622911dd95ed6ebac8119c.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8be83deb815ca12f4c76872cd23872f8.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_4b5246a49f35494e234c60830205bd20.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8551f03173d5ebef5aeac489b5c42863.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_20205f769484ba6b7190125b25faaa05.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_d6df23203500769135c4aa618ed253d0.jpg',
                'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3d2f5d13caefe3ee80d0e00a5e7671b0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42534,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_56d7dbe424306d4fccee8c3c8bb0a6a4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42534,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_fce14a703f462385175b47a88ae2f4eb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49018,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_f81a4ceaf539749cf4996202bde2a898.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80460,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_23a0131536c055af8335142656d62545.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76562,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_46f0400d41c3aaf2e1ee98d72186feb4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43268,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_80dbc712db39821fbc54f6cca965a3fd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44689,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_860906bf9bdf68e0461161df8dcf5435.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86001,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_ce7bc591fb27c87a53cdba07a376e9fb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43595,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3fbfa96ee3622911dd95ed6ebac8119c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43658,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8be83deb815ca12f4c76872cd23872f8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41889,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_4b5246a49f35494e234c60830205bd20.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21066,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_8551f03173d5ebef5aeac489b5c42863.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34297,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_20205f769484ba6b7190125b25faaa05.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40557,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_d6df23203500769135c4aa618ed253d0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_887b29f9-4597-5f8e-85e4-2b1733e87485/887b29f9-4597-5f8e-85e4-2b1733e87485_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/4d/ae4dc8a602fe73d73896b2de76b72e40/pa/NV22132_3d2f5d13caefe3ee80d0e00a5e7671b0.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV22132%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [auto1.it] INFO: Saving data for NV22132: {'auction_closing_time': 1769704614.0, 'created_time': 1769594537.608275, 'last_price_update_time': 1769594537.608288}
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NV22132') HTTP/1.1" 204 0
2026-01-28 10:02:17 [auto1.it] INFO: Found listing with ID: NC16771
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC16771%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [auto1.it] INFO: Scrape type for NC16771: 1
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg not downloaded yet
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg not downloaded yet
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3dc9d0>
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg saved to cache
2026-01-28 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3b1010>
2026-01-28 10:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_4f4a727eae18304230286294e3b2a298.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_4f4a727eae18304230286294e3b2a298.jpg saved to cache
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_da8988b7b88e64659cc72b9e695427f9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:18 [auto1.it] INFO: Found listing with ID: KF48878
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF48878%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [auto1.it] INFO: Scrape type for KF48878: 1
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_2ef5820e176b70b503819be8f73c2ba3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_2ef5820e176b70b503819be8f73c2ba3.jpg not downloaded yet
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg not downloaded yet
2026-01-28 10:02:18 [auto1.it] INFO: Found listing with ID: ES44570
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44570%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [auto1.it] INFO: Scrape type for ES44570: 2
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_7d397d7e5503c93d4c4c666735e60af1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7d397d7e5503c93d4c4c666735e60af1.jpg not downloaded yet
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_239a7a79735b2b60a97990116f84af22.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_239a7a79735b2b60a97990116f84af22.jpg not downloaded yet
2026-01-28 10:02:18 [auto1.it] INFO: Found listing with ID: LN71462
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN71462%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [auto1.it] INFO: Scrape type for LN71462: 1
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_49d81597ca058530acdccb6500634b64.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_49d81597ca058530acdccb6500634b64.jpg not downloaded yet
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_bdc07f93a5159b9f7a81bac0b4c89a5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_bdc07f93a5159b9f7a81bac0b4c89a5b.jpg already downloaded
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_de89c4a6006ebbcc1e946483de8854a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_de89c4a6006ebbcc1e946483de8854a0.jpg not downloaded yet
2026-01-28 10:02:18 [auto1.it] INFO: Found listing with ID: MM11522
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM11522%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [auto1.it] INFO: Scrape type for MM11522: 1
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg not downloaded yet
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_1573fdb603a677775e537b3f496fe400.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_1573fdb603a677775e537b3f496fe400.jpg not downloaded yet
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4067710>
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_da8988b7b88e64659cc72b9e695427f9.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_da8988b7b88e64659cc72b9e695427f9.jpg saved to cache
2026-01-28 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5d1850>
2026-01-28 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg saved to cache
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: KC58138
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for KC58138: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_c40dabcece5c4fb819f66c621a55ead3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c40dabcece5c4fb819f66c621a55ead3.jpg not downloaded yet
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_0d2ffda0ef6ad61201cf647188d60524.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_0d2ffda0ef6ad61201cf647188d60524.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_f3a1b198a6890dcf325b3fe1eadc8792.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_f3a1b198a6890dcf325b3fe1eadc8792.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_d0112f7527e23d359131907e5b34bfe0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_d0112f7527e23d359131907e5b34bfe0.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_9cd022bc7da9d39e862e406d168e8738.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_9cd022bc7da9d39e862e406d168e8738.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_ea0b97a0393ccad0b64ee48e38572175.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_ea0b97a0393ccad0b64ee48e38572175.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_6648b65daad3b423d172e85734e83160.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_6648b65daad3b423d172e85734e83160.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_decc8ab4ed4da7913e4e7d8a14ca1da1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_decc8ab4ed4da7913e4e7d8a14ca1da1.jpg already downloaded
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_7d476b6b6b480185b0d159257144fcef.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_7d476b6b6b480185b0d159257144fcef.jpg already downloaded
2026-01-28 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: FZ17961
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ17961%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for FZ17961: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_96ebba9c8255c6343222ba3f67985170.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_96ebba9c8255c6343222ba3f67985170.jpg not downloaded yet
2026-01-28 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ55749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: KG20319
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG20319%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for KG20319: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_e632f74a6a04cee01637d299c8c57956.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_e632f74a6a04cee01637d299c8c57956.jpg not downloaded yet
2026-01-28 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_64020a25c8368d24d18bf5f81211ddc0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: YL40875
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL40875%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for YL40875: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_24516de8f3e7bd3ac108da7417587e16.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_24516de8f3e7bd3ac108da7417587e16.jpg not downloaded yet
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: JF20294
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF20294%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for JF20294: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_7db0439039eab5bfe1d2bb99998094ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7db0439039eab5bfe1d2bb99998094ee.jpg not downloaded yet
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22b190>
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg saved to cache
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:19 [auto1.it] INFO: Found listing with ID: XR31937
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR31937%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [auto1.it] INFO: Scrape type for XR31937: 2
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_c83be7bc0d60132bbb3e203947ef854f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c83be7bc0d60132bbb3e203947ef854f.jpg not downloaded yet
2026-01-28 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG22278> (referer: https://www.auto1.com/v1/car-details-view/WG22278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f406e710>
2026-01-28 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_64020a25c8368d24d18bf5f81211ddc0.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_64020a25c8368d24d18bf5f81211ddc0.jpg saved to cache
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_819885d43ddd8b81f96bd642b378da8a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:20 [auto1.it] INFO: Found listing with ID: MR06591
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR06591%27 HTTP/1.1" 200 None
2026-01-28 10:02:20 [auto1.it] INFO: Scrape type for MR06591: 2
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_45a6670c6d144a94981503cae149d125.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_45a6670c6d144a94981503cae149d125.jpg not downloaded yet
2026-01-28 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW96841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:20 [auto1.it] INFO: Found listing with ID: UZ25178
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ25178%27 HTTP/1.1" 200 None
2026-01-28 10:02:20 [auto1.it] INFO: Scrape type for UZ25178: 1
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_3c70546f8c3693d43fbb485a00055a7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_3c70546f8c3693d43fbb485a00055a7a.jpg not downloaded yet
2026-01-28 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP68527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3dbb90>
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg saved to cache
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2026-01-28 10:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4ec92c-8e59-541f-9ce2-49123826fa54 with scrape type 2
2026-01-28 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4ec92c-8e59-541f-9ce2-49123826fa54 with scrape type 2
2026-01-28 10:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a4ec92c-8e59-541f-9ce2-49123826fa54, identifier: WG22278
2026-01-28 10:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2026-01-28 10:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2026-01-28 10:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278 to the API
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG22278>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:46:54Z',
 'fuel_type': 'petrol',
 'id': '6a4ec92c-8e59-541f-9ce2-49123826fa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG22278',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 33894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2026-01-28 10:02:21 [auto1.it] INFO: Saving data for WG22278: {'auction_closing_time': 1769705214.0, 'created_time': 1768298510.031538, 'last_price_update_time': 1769594541.444838}
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG22278') HTTP/1.1" 204 0
2026-01-28 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_f0801ff085bcec01e289e6fc627afe05.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:21 [auto1.it] INFO: Found listing with ID: RC65604
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC65604%27 HTTP/1.1" 200 None
2026-01-28 10:02:21 [auto1.it] INFO: Scrape type for RC65604: 1
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_4806c23ae21dfb8e02c5104640938f65.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_4806c23ae21dfb8e02c5104640938f65.jpg not downloaded yet
2026-01-28 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee413250>
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_819885d43ddd8b81f96bd642b378da8a.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_819885d43ddd8b81f96bd642b378da8a.jpg saved to cache
2026-01-28 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee52c5d0>
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg saved to cache
2026-01-28 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_1573fdb603a677775e537b3f496fe400.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:22 [auto1.it] INFO: Found listing with ID: WY20430
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY20430%27 HTTP/1.1" 200 None
2026-01-28 10:02:22 [auto1.it] INFO: Scrape type for WY20430: 2
2026-01-28 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_ef9455dc05b74eb361745e004a2ca583.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:22 [auto1.it] INFO: Found listing with ID: RT85289
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT85289%27 HTTP/1.1" 200 None
2026-01-28 10:02:22 [auto1.it] INFO: Scrape type for RT85289: 2
2026-01-28 10:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4134a50>
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_f0801ff085bcec01e289e6fc627afe05.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_f0801ff085bcec01e289e6fc627afe05.jpg saved to cache
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee378210>
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg saved to cache
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:02:23 [auto1.it] INFO: Found listing with ID: HJ72806
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ72806%27 HTTP/1.1" 200 None
2026-01-28 10:02:23 [auto1.it] INFO: Scrape type for HJ72806: 2
2026-01-28 10:02:23 [auto1.it] INFO: Found listing with ID: WL71449
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL71449%27 HTTP/1.1" 200 None
2026-01-28 10:02:23 [auto1.it] INFO: Scrape type for WL71449: 2
2026-01-28 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR31937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3ecbd0>
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_1573fdb603a677775e537b3f496fe400.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_1573fdb603a677775e537b3f496fe400.jpg saved to cache
2026-01-28 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:02:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee23d690>
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg saved to cache
2026-01-28 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4301d0>
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_ef9455dc05b74eb361745e004a2ca583.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_ef9455dc05b74eb361745e004a2ca583.jpg saved to cache
2026-01-28 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: MB91559
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for MB91559: 1
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: VU61741
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU61741%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for VU61741: 2
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: LB74870
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB74870%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for LB74870: 2
2026-01-28 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_0a828df5beead0040b9eb27a1467c9de.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: EA80460
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA80460%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for EA80460: 1
2026-01-28 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_4806c23ae21dfb8e02c5104640938f65.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: WC27393
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC27393%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for WC27393: 1
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: ZR94610
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR94610%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for ZR94610: 2
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: DC36763
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC36763%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for DC36763: 2
2026-01-28 10:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_a684a039261b225ed31717f0e21a0f0b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:24 [auto1.it] INFO: Found listing with ID: HL82578
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL82578%27 HTTP/1.1" 200 None
2026-01-28 10:02:24 [auto1.it] INFO: Scrape type for HL82578: 2
2026-01-28 10:02:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef43790>
2026-01-28 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_0a828df5beead0040b9eb27a1467c9de.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_0a828df5beead0040b9eb27a1467c9de.jpg saved to cache
2026-01-28 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee23fd90>
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_4806c23ae21dfb8e02c5104640938f65.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_4806c23ae21dfb8e02c5104640938f65.jpg saved to cache
2026-01-28 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:25 [auto1.it] INFO: Found listing with ID: LR66968
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66968%27 HTTP/1.1" 200 None
2026-01-28 10:02:25 [auto1.it] INFO: Scrape type for LR66968: 2
2026-01-28 10:02:25 [auto1.it] INFO: Found listing with ID: CB23984
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB23984%27 HTTP/1.1" 200 None
2026-01-28 10:02:25 [auto1.it] INFO: Scrape type for CB23984: 1
2026-01-28 10:02:25 [auto1.it] INFO: Found listing with ID: LA37582
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA37582%27 HTTP/1.1" 200 None
2026-01-28 10:02:25 [auto1.it] INFO: Scrape type for LA37582: 2
2026-01-28 10:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee413f50>
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_a684a039261b225ed31717f0e21a0f0b.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_a684a039261b225ed31717f0e21a0f0b.jpg saved to cache
2026-01-28 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: UH74677
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH74677%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for UH74677: 2
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: XZ42851
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ42851%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for XZ42851: 2
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: TJ69567
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ69567%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for TJ69567: 1
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL71449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: LB26900
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for LB26900: 1
2026-01-28 10:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT85289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ72806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: AJ95736
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ95736%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for AJ95736: 2
2026-01-28 10:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c40dabcece5c4fb819f66c621a55ead3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_e632f74a6a04cee01637d299c8c57956.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: DT16990
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT16990%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for DT16990: 2
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: BE13421
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE13421%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for BE13421: 2
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC65604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY20430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: JU28816
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28816%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for JU28816: 2
2026-01-28 10:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3c9c90>
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg saved to cache
2026-01-28 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:26 [auto1.it] INFO: Found listing with ID: YT86489
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT86489%27 HTTP/1.1" 200 None
2026-01-28 10:02:26 [auto1.it] INFO: Scrape type for YT86489: 2
2026-01-28 10:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee577690>
2026-01-28 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_c40dabcece5c4fb819f66c621a55ead3.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c40dabcece5c4fb819f66c621a55ead3.jpg saved to cache
2026-01-28 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee20b3d0>
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_e632f74a6a04cee01637d299c8c57956.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_e632f74a6a04cee01637d299c8c57956.jpg saved to cache
2026-01-28 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7db0439039eab5bfe1d2bb99998094ee.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c83be7bc0d60132bbb3e203947ef854f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:27 [auto1.it] INFO: Found listing with ID: AS87469
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS87469%27 HTTP/1.1" 200 None
2026-01-28 10:02:27 [auto1.it] INFO: Scrape type for AS87469: 2
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR31937> (referer: https://www.auto1.com/v1/car-details-view/XR31937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP68527> (referer: https://www.auto1.com/v1/car-details-view/MP68527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW96841> (referer: https://www.auto1.com/v1/car-details-view/UW96841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:27 [auto1.it] INFO: Found listing with ID: LY86301
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY86301%27 HTTP/1.1" 200 None
2026-01-28 10:02:27 [auto1.it] INFO: Scrape type for LY86301: 1
2026-01-28 10:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_3c70546f8c3693d43fbb485a00055a7a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f412aad0>
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_7db0439039eab5bfe1d2bb99998094ee.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7db0439039eab5bfe1d2bb99998094ee.jpg saved to cache
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3629d0>
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_c83be7bc0d60132bbb3e203947ef854f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c83be7bc0d60132bbb3e203947ef854f.jpg saved to cache
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ42851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR66968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA80460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with identifier: XR31937
2026-01-28 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with scrape type 2
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with scrape type 2
2026-01-28 10:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c, identifier: XR31937
2026-01-28 10:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with identifier: MP68527
2026-01-28 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with scrape type 1
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg not downloaded yet
2026-01-28 10:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eed57ad-4309-5ad3-a280-b71854595011 with identifier: UW96841
2026-01-28 10:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eed57ad-4309-5ad3-a280-b71854595011 with scrape type 1
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3eed57ad-4309-5ad3-a280-b71854595011
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_8949125718fc7f07acb26b7afc2ba5f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_8949125718fc7f07acb26b7afc2ba5f8.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_497bcdb2505992d37d1173da6e3115e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_497bcdb2505992d37d1173da6e3115e2.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_a2fc74940c19e586df1c8d1fd4e1a4ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_a2fc74940c19e586df1c8d1fd4e1a4ec.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_11af5c610347ac1e23ff2c9588fbcac3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_11af5c610347ac1e23ff2c9588fbcac3.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_d267e994a42a44bd80c58fccb152c18c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_d267e994a42a44bd80c58fccb152c18c.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_e2ea18b8e1cc3252af5de534a4393113.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e2ea18b8e1cc3252af5de534a4393113.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_40aa398b021b5942e8903f2a0fe61508.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_40aa398b021b5942e8903f2a0fe61508.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_e276ddea99609284b35f2cb3528bdaec.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e276ddea99609284b35f2cb3528bdaec.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_7c0517aabc05b9e78307397a1bf6f9c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7c0517aabc05b9e78307397a1bf6f9c2.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_6c8e4621db830ac4cf894dc9bbc59742.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_6c8e4621db830ac4cf894dc9bbc59742.jpg already downloaded
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_3bf35ed7807c26eecca1e33f2783a255.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_3bf35ed7807c26eecca1e33f2783a255.jpg already downloaded
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_1d251912f3c05365aba10cf229c66eef.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_1d251912f3c05365aba10cf229c66eef.jpg already downloaded
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_7a256fa9426e4815d1d901207ca1b76f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7a256fa9426e4815d1d901207ca1b76f.jpg already downloaded
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_0b56ec80d21d1cfb689aa3759af5171d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_0b56ec80d21d1cfb689aa3759af5171d.jpg already downloaded
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Ff7%252Ff3f785d65dfdab281d8b25267a6d027d%252Fpa%252FUW96841_061a7ed5a7cf49e8832923e5cfdf803d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_061a7ed5a7cf49e8832923e5cfdf803d.jpg already downloaded
2026-01-28 10:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3eed57ad-4309-5ad3-a280-b71854595011, identifier: UW96841
2026-01-28 10:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5bb790>
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_3c70546f8c3693d43fbb485a00055a7a.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_3c70546f8c3693d43fbb485a00055a7a.jpg saved to cache
2026-01-28 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with identifier: XR31937
2026-01-28 10:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with identifier: XR31937
2026-01-28 10:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c with identifier: XR31937 to the API
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR31937>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:24:41Z',
 'fuel_type': 'diesel',
 'id': '7cb7d322-075b-5ea0-b6b1-e3ee2ff4315c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR31937',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 124207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2021}
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR31937%27 HTTP/1.1" 200 None
2026-01-28 10:02:29 [auto1.it] INFO: Saving data for XR31937: {'auction_closing_time': 1769703881.0, 'created_time': 1767902453.962687, 'last_price_update_time': 1769594549.871258}
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR31937') HTTP/1.1" 204 0
2026-01-28 10:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3eed57ad-4309-5ad3-a280-b71854595011 with identifier: UW96841
2026-01-28 10:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3eed57ad-4309-5ad3-a280-b71854595011 with identifier: UW96841
2026-01-28 10:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3eed57ad-4309-5ad3-a280-b71854595011 with identifier: UW96841 to the API
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW96841>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:05:47Z',
 'fuel_type': 'diesel',
 'id': '3eed57ad-4309-5ad3-a280-b71854595011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW96841',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 97258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_8949125718fc7f07acb26b7afc2ba5f8.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_497bcdb2505992d37d1173da6e3115e2.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_a2fc74940c19e586df1c8d1fd4e1a4ec.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_11af5c610347ac1e23ff2c9588fbcac3.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_d267e994a42a44bd80c58fccb152c18c.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e2ea18b8e1cc3252af5de534a4393113.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_40aa398b021b5942e8903f2a0fe61508.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e276ddea99609284b35f2cb3528bdaec.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7c0517aabc05b9e78307397a1bf6f9c2.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_6c8e4621db830ac4cf894dc9bbc59742.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_3bf35ed7807c26eecca1e33f2783a255.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_1d251912f3c05365aba10cf229c66eef.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7a256fa9426e4815d1d901207ca1b76f.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_0b56ec80d21d1cfb689aa3759af5171d.jpg',
                'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_061a7ed5a7cf49e8832923e5cfdf803d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_8949125718fc7f07acb26b7afc2ba5f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2513217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_497bcdb2505992d37d1173da6e3115e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_a2fc74940c19e586df1c8d1fd4e1a4ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_11af5c610347ac1e23ff2c9588fbcac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_d267e994a42a44bd80c58fccb152c18c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e2ea18b8e1cc3252af5de534a4393113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_40aa398b021b5942e8903f2a0fe61508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_e276ddea99609284b35f2cb3528bdaec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7c0517aabc05b9e78307397a1bf6f9c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_6c8e4621db830ac4cf894dc9bbc59742.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_3bf35ed7807c26eecca1e33f2783a255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_1d251912f3c05365aba10cf229c66eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_7a256fa9426e4815d1d901207ca1b76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_0b56ec80d21d1cfb689aa3759af5171d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eed57ad-4309-5ad3-a280-b71854595011/3eed57ad-4309-5ad3-a280-b71854595011_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/f7/f3f785d65dfdab281d8b25267a6d027d/pa/UW96841_061a7ed5a7cf49e8832923e5cfdf803d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96841%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [auto1.it] INFO: Saving data for UW96841: {'created_time': 1769594550.476163, 'last_price_update_time': 1769594550.476173, 'auction_closing_time': 1769702747.0}
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW96841') HTTP/1.1" 204 0
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg not downloaded yet
2026-01-28 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ69567/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_85ac9809a93d5ae934aa29c612121736.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_85ac9809a93d5ae934aa29c612121736.jpg not downloaded yet
2026-01-28 10:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_db40956307c7f6a0b464f1c12772b70b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_db40956307c7f6a0b464f1c12772b70b.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_0481290c2671b2825bd1da7e61c72a9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_0481290c2671b2825bd1da7e61c72a9c.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg not downloaded yet
2026-01-28 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_bd54b80d58ad7f893a6c673bb543407a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_bd54b80d58ad7f893a6c673bb543407a.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_f5146c7c51dde0806df7495ff708c272.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f5146c7c51dde0806df7495ff708c272.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_07fbb67f995b9611eed02ca0c113763b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_07fbb67f995b9611eed02ca0c113763b.jpg not downloaded yet
2026-01-28 10:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg not downloaded yet
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg not downloaded yet
2026-01-28 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef0d810>
2026-01-28 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg saved to cache
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f5146c7c51dde0806df7495ff708c272.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_29c5dfb47ab549c83f171daf20defa12.png%27 HTTP/1.1" 200 None
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_29c5dfb47ab549c83f171daf20defa12.png not downloaded yet
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee367490>
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg saved to cache
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4ea3310>
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_f5146c7c51dde0806df7495ff708c272.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f5146c7c51dde0806df7495ff708c272.jpg saved to cache
2026-01-28 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ72806> (referer: https://www.auto1.com/v1/car-details-view/HJ72806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY86301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT86489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC65604> (referer: https://www.auto1.com/v1/car-details-view/RC65604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeea7dd0>
2026-01-28 10:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg saved to cache
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_29c5dfb47ab549c83f171daf20defa12.png> (referer: https://www.auto1.com/)
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS87469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY20430> (referer: https://www.auto1.com/v1/car-details-view/WY20430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL71449> (referer: https://www.auto1.com/v1/car-details-view/WL71449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT85289> (referer: https://www.auto1.com/v1/car-details-view/RT85289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07b1e3d-ed75-56cc-a7fb-88955855fe90 with identifier: HJ72806
2026-01-28 10:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07b1e3d-ed75-56cc-a7fb-88955855fe90 with scrape type 2
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07b1e3d-ed75-56cc-a7fb-88955855fe90 with scrape type 2
2026-01-28 10:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c07b1e3d-ed75-56cc-a7fb-88955855fe90, identifier: HJ72806
2026-01-28 10:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with identifier: RC65604
2026-01-28 10:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with scrape type 1
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_27f34852583bada59d0cb3437d54e0d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_27f34852583bada59d0cb3437d54e0d4.jpg not downloaded yet
2026-01-28 10:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c07b1e3d-ed75-56cc-a7fb-88955855fe90 with identifier: HJ72806
2026-01-28 10:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c07b1e3d-ed75-56cc-a7fb-88955855fe90 with identifier: HJ72806
2026-01-28 10:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c07b1e3d-ed75-56cc-a7fb-88955855fe90 with identifier: HJ72806 to the API
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HJ72806>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:37:09Z',
 'fuel_type': 'diesel',
 'id': 'c07b1e3d-ed75-56cc-a7fb-88955855fe90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ72806',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 50116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ72806%27 HTTP/1.1" 200 None
2026-01-28 10:02:32 [auto1.it] INFO: Saving data for HJ72806: {'auction_closing_time': 1769704629.0, 'created_time': 1769199247.817961, 'last_price_update_time': 1769594552.669575}
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HJ72806') HTTP/1.1" 204 0
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_07fbb67f995b9611eed02ca0c113763b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_ec09d90258054ab7091bde4b03a7cb70.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_ec09d90258054ab7091bde4b03a7cb70.jpg not downloaded yet
2026-01-28 10:02:32 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 10:02:32 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 10:02:32 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 10:02:32 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 359 77
2026-01-28 10:02:32 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 448 8192
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f412b790>
2026-01-28 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_14.png HTTP/1.1" 201 0
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_29c5dfb47ab549c83f171daf20defa12.png') HTTP/1.1" 204 0
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_29c5dfb47ab549c83f171daf20defa12.png saved to cache
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb88d828-daf6-5df4-a540-d4e50815855b with identifier: WY20430
2026-01-28 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb88d828-daf6-5df4-a540-d4e50815855b with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb88d828-daf6-5df4-a540-d4e50815855b with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb88d828-daf6-5df4-a540-d4e50815855b, identifier: WY20430
2026-01-28 10:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612888cb-ea8b-5a93-9c2d-db48ed532818 with identifier: WL71449
2026-01-28 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612888cb-ea8b-5a93-9c2d-db48ed532818 with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612888cb-ea8b-5a93-9c2d-db48ed532818 with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 612888cb-ea8b-5a93-9c2d-db48ed532818, identifier: WL71449
2026-01-28 10:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with identifier: RT85289
2026-01-28 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with scrape type 2
2026-01-28 10:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee5e3a93-7b71-5a82-8643-4a386b98d9d8, identifier: RT85289
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_95c3710eb7d449dc11e59644987f0126.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_95c3710eb7d449dc11e59644987f0126.jpg not downloaded yet
2026-01-28 10:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb88d828-daf6-5df4-a540-d4e50815855b with identifier: WY20430
2026-01-28 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb88d828-daf6-5df4-a540-d4e50815855b with identifier: WY20430
2026-01-28 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161148 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161148
2026-01-28 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fb88d828-daf6-5df4-a540-d4e50815855b spider: auto1.it
2026-01-28 10:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fb88d828-daf6-5df4-a540-d4e50815855b due to rule: high_mileage_for_country.json, error: 161148 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161148
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:04:17Z',
 'fuel_type': 'diesel',
 'id': 'fb88d828-daf6-5df4-a540-d4e50815855b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY20430',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 161148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2020}
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY20430%27 HTTP/1.1" 200 None
2026-01-28 10:02:33 [auto1.it] INFO: Saving data for WY20430: {'auction_closing_time': 1769702657.0, 'created_time': 1768298830.879711, 'last_price_update_time': 1769594553.775867}
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY20430') HTTP/1.1" 204 0
2026-01-28 10:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 612888cb-ea8b-5a93-9c2d-db48ed532818 with identifier: WL71449
2026-01-28 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 612888cb-ea8b-5a93-9c2d-db48ed532818 with identifier: WL71449
2026-01-28 10:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 612888cb-ea8b-5a93-9c2d-db48ed532818 with identifier: WL71449 to the API
2026-01-28 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL71449>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:49:03Z',
 'fuel_type': 'hybrid',
 'id': '612888cb-ea8b-5a93-9c2d-db48ed532818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL71449',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 65497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4 Dynamic +',
 'transmission': 'automatic',
 'trim': '4x4 Dynamic +',
 'year': 2022}
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL71449%27 HTTP/1.1" 200 None
2026-01-28 10:02:34 [auto1.it] INFO: Saving data for WL71449: {'auction_closing_time': 1769705343.0, 'created_time': 1768420892.413558, 'last_price_update_time': 1769594554.204941}
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL71449') HTTP/1.1" 204 0
2026-01-28 10:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with identifier: RT85289
2026-01-28 10:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with identifier: RT85289
2026-01-28 10:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee5e3a93-7b71-5a82-8643-4a386b98d9d8 with identifier: RT85289 to the API
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT85289>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:17:04Z',
 'fuel_type': 'petrol',
 'id': 'ee5e3a93-7b71-5a82-8643-4a386b98d9d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT85289',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 69661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2020}
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT85289%27 HTTP/1.1" 200 None
2026-01-28 10:02:34 [auto1.it] INFO: Saving data for RT85289: {'auction_closing_time': 1769703424.0, 'created_time': 1769155238.902597, 'last_price_update_time': 1769594554.551957}
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT85289') HTTP/1.1" 204 0
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_bd54b80d58ad7f893a6c673bb543407a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_0481290c2671b2825bd1da7e61c72a9c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_db40956307c7f6a0b464f1c12772b70b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_2894ab96d4210fc91dff214602ce8b28.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_2894ab96d4210fc91dff214602ce8b28.jpg not downloaded yet
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU28816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT16990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE13421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f409cd90>
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg saved to cache
2026-01-28 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee313110>
2026-01-28 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg saved to cache
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee338c10>
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg saved to cache
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee397910>
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_07fbb67f995b9611eed02ca0c113763b.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_07fbb67f995b9611eed02ca0c113763b.jpg saved to cache
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_27f34852583bada59d0cb3437d54e0d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg not downloaded yet
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH74677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ95736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ69567> (referer: https://www.auto1.com/v1/car-details-view/TJ69567/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB26900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA37582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40bf210>
2026-01-28 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_bd54b80d58ad7f893a6c673bb543407a.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_bd54b80d58ad7f893a6c673bb543407a.jpg saved to cache
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3ec450>
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg saved to cache
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f412a750>
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_0481290c2671b2825bd1da7e61c72a9c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_0481290c2671b2825bd1da7e61c72a9c.jpg saved to cache
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4e0c50>
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_db40956307c7f6a0b464f1c12772b70b.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_db40956307c7f6a0b464f1c12772b70b.jpg saved to cache
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0904993bebe96728b935bc0dc76048a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0904993bebe96728b935bc0dc76048a3.jpg not downloaded yet
2026-01-28 10:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_95c3710eb7d449dc11e59644987f0126.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_ec09d90258054ab7091bde4b03a7cb70.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_85ac9809a93d5ae934aa29c612121736.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg not downloaded yet
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefcaf90>
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_27f34852583bada59d0cb3437d54e0d4.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_27f34852583bada59d0cb3437d54e0d4.jpg saved to cache
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5c14b00-ab29-50e9-8f5e-029016528faf with identifier: TJ69567
2026-01-28 10:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c14b00-ab29-50e9-8f5e-029016528faf with scrape type 1
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e5c14b00-ab29-50e9-8f5e-029016528faf
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_0bb1ce5ebc7e71ca993fde0739d18fee.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0bb1ce5ebc7e71ca993fde0739d18fee.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_fbe62faaac2b2a59d841e07f8a797689.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_fbe62faaac2b2a59d841e07f8a797689.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_eb3183bb9fa2c8b5bad7189f0716f347.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_eb3183bb9fa2c8b5bad7189f0716f347.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_e6a4372b2b99762b3093c945e90397de.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e6a4372b2b99762b3093c945e90397de.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_993355c4bdeca957a0de6c0d7721b234.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_993355c4bdeca957a0de6c0d7721b234.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_801015fbd6845361a0e155e31a1bdd9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_801015fbd6845361a0e155e31a1bdd9d.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_a019cb420af6e7d6fa3894eb6eb1a86f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_a019cb420af6e7d6fa3894eb6eb1a86f.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_21ceac8d304fff4b2f6079cbbe6a08ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_21ceac8d304fff4b2f6079cbbe6a08ca.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_7f4d32171c1fb88576b3145a9c4bbb98.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_7f4d32171c1fb88576b3145a9c4bbb98.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_e28ddab5a7ff64a25bb6119e4cf8af0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e28ddab5a7ff64a25bb6119e4cf8af0c.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_ad35ffeadafd236a371df24acc5503b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_ad35ffeadafd236a371df24acc5503b2.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_0a1cee3d27158ce8a0c3d72c03d4a4e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0a1cee3d27158ce8a0c3d72c03d4a4e8.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_c43fbffa8933e81b4554594f987bfaa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_c43fbffa8933e81b4554594f987bfaa8.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_30014b67fcf02a7b51e98062824c1f1f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_30014b67fcf02a7b51e98062824c1f1f.jpg already downloaded
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F59%252Fb759e94889923f0170e88fe8d06d6db6%252Fpa%252FTJ69567_76008e0252352a8fa9fd385c4bcab041.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_76008e0252352a8fa9fd385c4bcab041.jpg already downloaded
2026-01-28 10:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5c14b00-ab29-50e9-8f5e-029016528faf, identifier: TJ69567
2026-01-28 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_2894ab96d4210fc91dff214602ce8b28.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg not downloaded yet
2026-01-28 10:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5c14b00-ab29-50e9-8f5e-029016528faf with identifier: TJ69567
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:02:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-01-28 10:02:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5c14b00-ab29-50e9-8f5e-029016528faf with identifier: TJ69567
2026-01-28 10:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5c14b00-ab29-50e9-8f5e-029016528faf with identifier: TJ69567 to the API
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TJ69567>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 340,
 'expiration_date': '2026-01-29T16:21:52Z',
 'fuel_type': 'electro',
 'id': 'e5c14b00-ab29-50e9-8f5e-029016528faf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ69567',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 29722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0bb1ce5ebc7e71ca993fde0739d18fee.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_fbe62faaac2b2a59d841e07f8a797689.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_eb3183bb9fa2c8b5bad7189f0716f347.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e6a4372b2b99762b3093c945e90397de.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_993355c4bdeca957a0de6c0d7721b234.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_801015fbd6845361a0e155e31a1bdd9d.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_a019cb420af6e7d6fa3894eb6eb1a86f.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_21ceac8d304fff4b2f6079cbbe6a08ca.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_7f4d32171c1fb88576b3145a9c4bbb98.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e28ddab5a7ff64a25bb6119e4cf8af0c.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_ad35ffeadafd236a371df24acc5503b2.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0a1cee3d27158ce8a0c3d72c03d4a4e8.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_c43fbffa8933e81b4554594f987bfaa8.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_30014b67fcf02a7b51e98062824c1f1f.jpg',
                'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_76008e0252352a8fa9fd385c4bcab041.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3295797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0bb1ce5ebc7e71ca993fde0739d18fee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_fbe62faaac2b2a59d841e07f8a797689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3249329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_eb3183bb9fa2c8b5bad7189f0716f347.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e6a4372b2b99762b3093c945e90397de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_993355c4bdeca957a0de6c0d7721b234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3340285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_801015fbd6845361a0e155e31a1bdd9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_a019cb420af6e7d6fa3894eb6eb1a86f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_21ceac8d304fff4b2f6079cbbe6a08ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_7f4d32171c1fb88576b3145a9c4bbb98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_e28ddab5a7ff64a25bb6119e4cf8af0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_ad35ffeadafd236a371df24acc5503b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_0a1cee3d27158ce8a0c3d72c03d4a4e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_c43fbffa8933e81b4554594f987bfaa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394753,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_30014b67fcf02a7b51e98062824c1f1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c14b00-ab29-50e9-8f5e-029016528faf/e5c14b00-ab29-50e9-8f5e-029016528faf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/59/b759e94889923f0170e88fe8d06d6db6/pa/TJ69567_76008e0252352a8fa9fd385c4bcab041.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW i4 eDrive40 Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ69567%27 HTTP/1.1" 200 None
2026-01-28 10:02:38 [auto1.it] INFO: Saving data for TJ69567: {'created_time': 1769594558.639135, 'last_price_update_time': 1769594558.639146, 'auction_closing_time': 1769703712.0}
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ69567') HTTP/1.1" 204 0
2026-01-28 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_8ec6585d115e678020e612b2a5f5f730.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_8ec6585d115e678020e612b2a5f5f730.jpg not downloaded yet
2026-01-28 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0904993bebe96728b935bc0dc76048a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f412a690>
2026-01-28 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_95c3710eb7d449dc11e59644987f0126.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_95c3710eb7d449dc11e59644987f0126.jpg saved to cache
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f53c7110>
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_ec09d90258054ab7091bde4b03a7cb70.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_ec09d90258054ab7091bde4b03a7cb70.jpg saved to cache
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee556810>
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg saved to cache
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee57eb50>
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F4c%252Ff74cc26a342ec669c1e0e58c5ef7f7bd%252Fpa%252FMP68527_85ac9809a93d5ae934aa29c612121736.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_85ac9809a93d5ae934aa29c612121736.jpg saved to cache
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4
2026-01-28 10:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4, skipping ID generation
2026-01-28 10:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with scrape type 1
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 from tracking dictionaries
2026-01-28 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 sending to next pipeline
2026-01-28 10:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4, identifier: MP68527
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefa9510>
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_2894ab96d4210fc91dff214602ce8b28.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_2894ab96d4210fc91dff214602ce8b28.jpg saved to cache
2026-01-28 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg not downloaded yet
2026-01-28 10:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with identifier: MP68527
2026-01-28 10:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with identifier: MP68527
2026-01-28 10:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a640a2e6-e20a-57fb-a8d2-fbdeff393cc4 with identifier: MP68527 to the API
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_85ac9809a93d5ae934aa29c612121736.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:28:49Z',
 'fuel_type': 'petrol',
 'id': 'a640a2e6-e20a-57fb-a8d2-fbdeff393cc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP68527',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 38941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81243,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f842a289dd6af5f3b20dd1f83c0ad3e4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81243,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_1020aa0fb1b8e419fda1c11188aed6fd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68428,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_85ac9809a93d5ae934aa29c612121736.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65977,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_db40956307c7f6a0b464f1c12772b70b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65977,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_0481290c2671b2825bd1da7e61c72a9c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58270,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_554e3c090cc0aa2a7ffa772f209dd558.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81243,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_b98845bbde5aa35f51bbac25682e7d5a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47097,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_bd54b80d58ad7f893a6c673bb543407a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56370,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_cc8fdffc09a9c1a196afa01aee0293ea.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33464,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_49c7cf6fc7b2515dc0bea22acc62bfee.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43325,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_f5146c7c51dde0806df7495ff708c272.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23466,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_07fbb67f995b9611eed02ca0c113763b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35603,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_fd01fe6cec3ad097035b4ab8a060ac23.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33003,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_35a0ad974b3f212fbb15a91050fa6e98.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a640a2e6-e20a-57fb-a8d2-fbdeff393cc4/a640a2e6-e20a-57fb-a8d2-fbdeff393cc4_image_14.png',
             'Extension': 'png',
             'FileSizeInBytes': 374582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/4c/f74cc26a342ec669c1e0e58c5ef7f7bd/pa/MP68527_29c5dfb47ab549c83f171daf20defa12.png',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2021}
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP68527%27 HTTP/1.1" 200 None
2026-01-28 10:02:40 [auto1.it] INFO: Saving data for MP68527: {'created_time': 1769594560.805859, 'last_price_update_time': 1769594560.805869, 'auction_closing_time': 1769704129.0}
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP68527') HTTP/1.1" 204 0
2026-01-28 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY86301> (referer: https://www.auto1.com/v1/car-details-view/LY86301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT86489> (referer: https://www.auto1.com/v1/car-details-view/YT86489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA80460> (referer: https://www.auto1.com/v1/car-details-view/EA80460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg not downloaded yet
2026-01-28 10:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee222350>
2026-01-28 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg saved to cache
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee599ad0>
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0904993bebe96728b935bc0dc76048a3.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0904993bebe96728b935bc0dc76048a3.jpg saved to cache
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee403590>
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg saved to cache
2026-01-28 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_8ec6585d115e678020e612b2a5f5f730.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg not downloaded yet
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS87469> (referer: https://www.auto1.com/v1/car-details-view/AS87469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE13421> (referer: https://www.auto1.com/v1/car-details-view/BE13421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT16990> (referer: https://www.auto1.com/v1/car-details-view/DT16990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee0910c-bad6-58d9-ad33-22f3fb3e178c with identifier: LY86301
2026-01-28 10:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee0910c-bad6-58d9-ad33-22f3fb3e178c with scrape type 1
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5ee0910c-bad6-58d9-ad33-22f3fb3e178c
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_21e97728060c709b68ba523697bbed92.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_21e97728060c709b68ba523697bbed92.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_1516e658d95206f1bae3c31ba6e4ddcb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1516e658d95206f1bae3c31ba6e4ddcb.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_9f43057a78cb8803d78376adab8ae1be.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_9f43057a78cb8803d78376adab8ae1be.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_4564b1616299fac24cff31573015bd4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4564b1616299fac24cff31573015bd4a.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_1d647f0bc9fb8b6197dc3bddad825ede.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1d647f0bc9fb8b6197dc3bddad825ede.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_d9ea5114139fe6f5feea49706958c7ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_d9ea5114139fe6f5feea49706958c7ae.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_4de516ca0a99ee009f441b142b001769.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4de516ca0a99ee009f441b142b001769.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_435bb51537315e7f83e3cdc8b99249d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_435bb51537315e7f83e3cdc8b99249d9.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_0b2e4dbfce977a2a5a886539a74125cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_0b2e4dbfce977a2a5a886539a74125cd.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_c9d9c74573ef053b7e663048d39c9115.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_c9d9c74573ef053b7e663048d39c9115.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_77562126498a0df623ae7a18072916e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_77562126498a0df623ae7a18072916e2.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_2f026d18cd5925ac1c3a139b345a3db8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_2f026d18cd5925ac1c3a139b345a3db8.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_e8514eee7450da900af765785ab85f75.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_e8514eee7450da900af765785ab85f75.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_89ffa875d0e18a6cc4661a2c6fcf03c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_89ffa875d0e18a6cc4661a2c6fcf03c9.jpg already downloaded
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F6b%252F146bd7ef466281cb20ba3dd2bb06f094%252Fpa%252FLY86301_b124e8673527a56132184e69640b0c90.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_b124e8673527a56132184e69640b0c90.jpg already downloaded
2026-01-28 10:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ee0910c-bad6-58d9-ad33-22f3fb3e178c, identifier: LY86301
2026-01-28 10:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62980077-e551-5141-b62f-84c0630f64bc with identifier: YT86489
2026-01-28 10:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62980077-e551-5141-b62f-84c0630f64bc with scrape type 2
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62980077-e551-5141-b62f-84c0630f64bc with scrape type 2
2026-01-28 10:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62980077-e551-5141-b62f-84c0630f64bc, identifier: YT86489
2026-01-28 10:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0de792-5bce-52c8-aaae-95e89c58f244 with identifier: EA80460
2026-01-28 10:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0de792-5bce-52c8-aaae-95e89c58f244 with scrape type 1
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_90040ca795fac18f38a73b3a90e5633e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_90040ca795fac18f38a73b3a90e5633e.jpg not downloaded yet
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_07b6126b0bc2015dc1cca0598e896d43.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_07b6126b0bc2015dc1cca0598e896d43.jpg not downloaded yet
2026-01-28 10:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR66968> (referer: https://www.auto1.com/v1/car-details-view/LR66968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ42851> (referer: https://www.auto1.com/v1/car-details-view/XZ42851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ee0910c-bad6-58d9-ad33-22f3fb3e178c with identifier: LY86301
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:02:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-28 10:02:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ee0910c-bad6-58d9-ad33-22f3fb3e178c with identifier: LY86301
2026-01-28 10:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ee0910c-bad6-58d9-ad33-22f3fb3e178c with identifier: LY86301 to the API
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY86301>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 280,
 'expiration_date': '2026-01-29T16:14:11Z',
 'fuel_type': 'hybrid',
 'id': '5ee0910c-bad6-58d9-ad33-22f3fb3e178c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY86301',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 27078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_21e97728060c709b68ba523697bbed92.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1516e658d95206f1bae3c31ba6e4ddcb.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_9f43057a78cb8803d78376adab8ae1be.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4564b1616299fac24cff31573015bd4a.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1d647f0bc9fb8b6197dc3bddad825ede.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_d9ea5114139fe6f5feea49706958c7ae.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4de516ca0a99ee009f441b142b001769.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_435bb51537315e7f83e3cdc8b99249d9.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_0b2e4dbfce977a2a5a886539a74125cd.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_c9d9c74573ef053b7e663048d39c9115.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_77562126498a0df623ae7a18072916e2.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_2f026d18cd5925ac1c3a139b345a3db8.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_e8514eee7450da900af765785ab85f75.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_89ffa875d0e18a6cc4661a2c6fcf03c9.jpg',
                'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_b124e8673527a56132184e69640b0c90.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275572,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_21e97728060c709b68ba523697bbed92.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275374,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1516e658d95206f1bae3c31ba6e4ddcb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_9f43057a78cb8803d78376adab8ae1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252895,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4564b1616299fac24cff31573015bd4a.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248248,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_1d647f0bc9fb8b6197dc3bddad825ede.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240647,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_d9ea5114139fe6f5feea49706958c7ae.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206912,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_4de516ca0a99ee009f441b142b001769.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257027,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_435bb51537315e7f83e3cdc8b99249d9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_0b2e4dbfce977a2a5a886539a74125cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250119,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_c9d9c74573ef053b7e663048d39c9115.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253034,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_77562126498a0df623ae7a18072916e2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_2f026d18cd5925ac1c3a139b345a3db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_e8514eee7450da900af765785ab85f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205280,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_89ffa875d0e18a6cc4661a2c6fcf03c9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ee0910c-bad6-58d9-ad33-22f3fb3e178c/5ee0910c-bad6-58d9-ad33-22f3fb3e178c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/6b/146bd7ef466281cb20ba3dd2bb06f094/pa/LY86301_b124e8673527a56132184e69640b0c90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Edizione Speciale AWD',
 'transmission': 'automatic',
 'trim': 'Edizione Speciale AWD',
 'year': 2023}
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY86301%27 HTTP/1.1" 200 None
2026-01-28 10:02:43 [auto1.it] INFO: Saving data for LY86301: {'created_time': 1769594563.348583, 'last_price_update_time': 1769594563.348595, 'auction_closing_time': 1769703251.0}
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY86301') HTTP/1.1" 204 0
2026-01-28 10:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62980077-e551-5141-b62f-84c0630f64bc with identifier: YT86489
2026-01-28 10:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62980077-e551-5141-b62f-84c0630f64bc with identifier: YT86489
2026-01-28 10:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62980077-e551-5141-b62f-84c0630f64bc with identifier: YT86489 to the API
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT86489>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:30:23Z',
 'fuel_type': 'petrol',
 'id': '62980077-e551-5141-b62f-84c0630f64bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT86489',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 37272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2022}
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT86489%27 HTTP/1.1" 200 None
2026-01-28 10:02:43 [auto1.it] INFO: Saving data for YT86489: {'auction_closing_time': 1769704223.0, 'created_time': 1768421015.234576, 'last_price_update_time': 1769594563.747196}
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT86489') HTTP/1.1" 204 0
2026-01-28 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg not downloaded yet
2026-01-28 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg not downloaded yet
2026-01-28 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef7b790>
2026-01-28 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_8ec6585d115e678020e612b2a5f5f730.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_8ec6585d115e678020e612b2a5f5f730.jpg saved to cache
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeee7410>
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg saved to cache
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with identifier: AS87469
2026-01-28 10:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with scrape type 2
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with scrape type 2
2026-01-28 10:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f, identifier: AS87469
2026-01-28 10:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 with identifier: BE13421
2026-01-28 10:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 with scrape type 2
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 with scrape type 2
2026-01-28 10:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81, identifier: BE13421
2026-01-28 10:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with identifier: DT16990
2026-01-28 10:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with scrape type 2
2026-01-28 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with scrape type 2
2026-01-28 10:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d, identifier: DT16990
2026-01-28 10:02:45 [scrapy.extensions.logstats] INFO: Crawled 106 pages (at 53 pages/min), scraped 25 items (at 17 items/min)
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_08770e3aaff481b3c72556c6080710f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_08770e3aaff481b3c72556c6080710f5.jpg not downloaded yet
2026-01-28 10:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with identifier: AS87469
2026-01-28 10:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with identifier: AS87469
2026-01-28 10:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a095c0a-b2ac-525e-b4d3-ca93709b7f8f with identifier: AS87469 to the API
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AS87469>
{'auction_title': '',
 'c_o_2_emission_value': 226,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 400,
 'expiration_date': '2026-01-29T16:52:49Z',
 'fuel_type': 'petrol',
 'id': '9a095c0a-b2ac-525e-b4d3-ca93709b7f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS87469',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 60439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS87469%27 HTTP/1.1" 200 None
2026-01-28 10:02:45 [auto1.it] INFO: Saving data for AS87469: {'auction_closing_time': 1769705569.0, 'created_time': 1768377709.586759, 'last_price_update_time': 1769594565.395977}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS87469') HTTP/1.1" 204 0
2026-01-28 10:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 with identifier: BE13421
2026-01-28 10:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 with identifier: BE13421
2026-01-28 10:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149150 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149150
2026-01-28 10:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 spider: auto1.it
2026-01-28 10:02:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0e70c9bd-8bbc-5045-8c8b-ea0a77770d81 due to rule: high_mileage_for_make.json, error: 149150 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149150
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:59:20Z',
 'fuel_type': 'diesel',
 'id': '0e70c9bd-8bbc-5045-8c8b-ea0a77770d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE13421',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 149150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2019}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE13421%27 HTTP/1.1" 200 None
2026-01-28 10:02:45 [auto1.it] INFO: Saving data for BE13421: {'auction_closing_time': 1769705960.0, 'created_time': 1768421028.230411, 'last_price_update_time': 1769594565.636535}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE13421') HTTP/1.1" 204 0
2026-01-28 10:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with identifier: DT16990
2026-01-28 10:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with identifier: DT16990
2026-01-28 10:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7588ce5d-ecd2-57c4-a253-b495a3f4bb4d with identifier: DT16990 to the API
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT16990>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2026-01-29T16:51:00Z',
 'fuel_type': 'hybrid',
 'id': '7588ce5d-ecd2-57c4-a253-b495a3f4bb4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT16990',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 102324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 Hybrid XPrime 2WD',
 'transmission': 'automatic',
 'trim': 'XPrime 2WD',
 'year': 2020}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT16990%27 HTTP/1.1" 200 None
2026-01-28 10:02:45 [auto1.it] INFO: Saving data for DT16990: {'auction_closing_time': 1769705460.0, 'created_time': 1767902450.561254, 'last_price_update_time': 1769594565.983832}
2026-01-28 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT16990') HTTP/1.1" 204 0
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe1b90>
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg saved to cache
2026-01-28 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with identifier: LR66968
2026-01-28 10:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with scrape type 2
2026-01-28 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with scrape type 2
2026-01-28 10:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1ff6492-e9bf-5679-8c6c-950f3f7974d2, identifier: LR66968
2026-01-28 10:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 with identifier: XZ42851
2026-01-28 10:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 with scrape type 2
2026-01-28 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 with scrape type 2
2026-01-28 10:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854, identifier: XZ42851
2026-01-28 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg not downloaded yet
2026-01-28 10:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with identifier: LR66968
2026-01-28 10:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with identifier: LR66968
2026-01-28 10:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1ff6492-e9bf-5679-8c6c-950f3f7974d2 with identifier: LR66968 to the API
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR66968>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 114,
 'expiration_date': '2026-01-29T16:54:32Z',
 'fuel_type': 'petrol',
 'id': 'c1ff6492-e9bf-5679-8c6c-950f3f7974d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR66968',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'DR',
 'model': 'DR Evo 4',
 'odometer': 59839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR Evo 4 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66968%27 HTTP/1.1" 200 None
2026-01-28 10:02:46 [auto1.it] INFO: Saving data for LR66968: {'auction_closing_time': 1769705672.0, 'created_time': 1767261683.22249, 'last_price_update_time': 1769594566.95021}
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR66968') HTTP/1.1" 204 0
2026-01-28 10:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 with identifier: XZ42851
2026-01-28 10:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 with identifier: XZ42851
2026-01-28 10:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
2026-01-28 10:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 spider: auto1.it
2026-01-28 10:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3b8dd13e-65c8-598c-bcd7-0c8e1b4df854 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
{'auction_title': '',
 'c_o_2_emission_value': 253,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.8L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:27:45Z',
 'fuel_type': 'diesel',
 'id': '3b8dd13e-65c8-598c-bcd7-0c8e1b4df854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ42851',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 6938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Hilux 2.8 D-4D Double Cab Lounge 4x4',
 'transmission': 'manual',
 'trim': 'Double Cab Lounge 4x4',
 'year': 2025}
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ42851%27 HTTP/1.1" 200 None
2026-01-28 10:02:47 [auto1.it] INFO: Saving data for XZ42851: {'auction_closing_time': 1769704065.0, 'created_time': 1767297735.678817, 'last_price_update_time': 1769594567.229238}
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XZ42851') HTTP/1.1" 204 0
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_53b8bf902483543a1ebbe259eed9c48c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_53b8bf902483543a1ebbe259eed9c48c.jpg not downloaded yet
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefda750>
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg saved to cache
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_07b6126b0bc2015dc1cca0598e896d43.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_57a89376c2e6622ed9c5b3e03430f034.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_57a89376c2e6622ed9c5b3e03430f034.jpg not downloaded yet
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefbe310>
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg saved to cache
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg not downloaded yet
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee309fd0>
2026-01-28 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_07b6126b0bc2015dc1cca0598e896d43.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_07b6126b0bc2015dc1cca0598e896d43.jpg saved to cache
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg not downloaded yet
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg not downloaded yet
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR94610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC36763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_675d7b98703877ae68a221e9c63f68ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_675d7b98703877ae68a221e9c63f68ea.jpg not downloaded yet
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_90040ca795fac18f38a73b3a90e5633e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg not downloaded yet
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg not downloaded yet
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA37582> (referer: https://www.auto1.com/v1/car-details-view/LA37582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_53b8bf902483543a1ebbe259eed9c48c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg not downloaded yet
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_08770e3aaff481b3c72556c6080710f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg not downloaded yet
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee309950>
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_90040ca795fac18f38a73b3a90e5633e.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_90040ca795fac18f38a73b3a90e5633e.jpg saved to cache
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB26900> (referer: https://www.auto1.com/v1/car-details-view/LB26900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL82578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ95736> (referer: https://www.auto1.com/v1/car-details-view/AJ95736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU28816> (referer: https://www.auto1.com/v1/car-details-view/JU28816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB23984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f80cb89-798d-5103-84b9-8bf306ceba2b with identifier: LA37582
2026-01-28 10:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f80cb89-798d-5103-84b9-8bf306ceba2b with scrape type 2
2026-01-28 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f80cb89-798d-5103-84b9-8bf306ceba2b with scrape type 2
2026-01-28 10:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f80cb89-798d-5103-84b9-8bf306ceba2b, identifier: LA37582
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5e8d10>
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_53b8bf902483543a1ebbe259eed9c48c.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_53b8bf902483543a1ebbe259eed9c48c.jpg saved to cache
2026-01-28 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee348190>
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_08770e3aaff481b3c72556c6080710f5.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_08770e3aaff481b3c72556c6080710f5.jpg saved to cache
2026-01-28 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f80cb89-798d-5103-84b9-8bf306ceba2b with identifier: LA37582
2026-01-28 10:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f80cb89-798d-5103-84b9-8bf306ceba2b with identifier: LA37582
2026-01-28 10:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f80cb89-798d-5103-84b9-8bf306ceba2b with identifier: LA37582 to the API
2026-01-28 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA37582>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-01-29T16:20:25Z',
 'fuel_type': 'petrol',
 'id': '4f80cb89-798d-5103-84b9-8bf306ceba2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA37582',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 30945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 M35i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2024}
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA37582%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [auto1.it] INFO: Saving data for LA37582: {'auction_closing_time': 1769703625.0, 'created_time': 1767989179.67079, 'last_price_update_time': 1769594570.271433}
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA37582') HTTP/1.1" 204 0
2026-01-28 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH74677> (referer: https://www.auto1.com/v1/car-details-view/UH74677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40519d0>
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg saved to cache
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-01-28 10:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca493fb-207a-5221-949c-696645256dd4 with scrape type 1
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5ca493fb-207a-5221-949c-696645256dd4
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_d9bdfba243dcfd00d68e0e2de43fc89e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_d9bdfba243dcfd00d68e0e2de43fc89e.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_822c55e8efe49b90b94fdabb9db155d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_822c55e8efe49b90b94fdabb9db155d3.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_218013d6f99b7198d84679ebb178fc28.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_218013d6f99b7198d84679ebb178fc28.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_0a5e5ab6941d34b6103471c10dfcbeae.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_0a5e5ab6941d34b6103471c10dfcbeae.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_2e96f27941a84b4a05244d65a162d443.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_2e96f27941a84b4a05244d65a162d443.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_cdba4fa9396386a94f7a2566f7b63c36.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_cdba4fa9396386a94f7a2566f7b63c36.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_dd936511945bb7848faf9a59c1e1f9f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_dd936511945bb7848faf9a59c1e1f9f8.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_e6f178dd7f3147ecc28485adc58e87a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_e6f178dd7f3147ecc28485adc58e87a8.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_59257c222c750b698d86be0872007208.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_59257c222c750b698d86be0872007208.jpg already downloaded
2026-01-28 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_ee4ae3a056b1b5925cc7f5fbe004808a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_ee4ae3a056b1b5925cc7f5fbe004808a.jpg already downloaded
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_f39de198d77b2280578a91ef496965a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_f39de198d77b2280578a91ef496965a5.jpg already downloaded
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_a8f2eac01375f121181bd94e9d680416.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_a8f2eac01375f121181bd94e9d680416.jpg already downloaded
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_bab985d34f6c0143a1d7cc26cf78e31a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_bab985d34f6c0143a1d7cc26cf78e31a.jpg already downloaded
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_c4f447b91ae2b1efca4b5b0b29bcdca8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_c4f447b91ae2b1efca4b5b0b29bcdca8.jpg already downloaded
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa44ca6a5966973fc48f581492baecf%252Fpa%252FLB26900_9ba94557bfeff3226e230ae1a481dea6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_9ba94557bfeff3226e230ae1a481dea6.jpg already downloaded
2026-01-28 10:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ca493fb-207a-5221-949c-696645256dd4, identifier: LB26900
2026-01-28 10:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f49ffad-86a6-5b8b-9032-23c10f64f845 with identifier: AJ95736
2026-01-28 10:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f49ffad-86a6-5b8b-9032-23c10f64f845 with scrape type 2
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f49ffad-86a6-5b8b-9032-23c10f64f845 with scrape type 2
2026-01-28 10:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f49ffad-86a6-5b8b-9032-23c10f64f845, identifier: AJ95736
2026-01-28 10:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with identifier: JU28816
2026-01-28 10:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with scrape type 2
2026-01-28 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with scrape type 2
2026-01-28 10:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c5747d6-84f6-54d9-ba94-d7d4b3844316, identifier: JU28816
2026-01-28 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_675d7b98703877ae68a221e9c63f68ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-01-28 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ca493fb-207a-5221-949c-696645256dd4 with identifier: LB26900
2026-01-28 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-28 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5ca493fb-207a-5221-949c-696645256dd4 spider: auto1.it
2026-01-28 10:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5ca493fb-207a-5221-949c-696645256dd4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-01-29T16:56:13Z',
 'fuel_type': 'diesel',
 'id': '5ca493fb-207a-5221-949c-696645256dd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB26900',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 130028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_d9bdfba243dcfd00d68e0e2de43fc89e.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_822c55e8efe49b90b94fdabb9db155d3.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_218013d6f99b7198d84679ebb178fc28.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_0a5e5ab6941d34b6103471c10dfcbeae.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_2e96f27941a84b4a05244d65a162d443.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_cdba4fa9396386a94f7a2566f7b63c36.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_dd936511945bb7848faf9a59c1e1f9f8.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_e6f178dd7f3147ecc28485adc58e87a8.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_59257c222c750b698d86be0872007208.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_ee4ae3a056b1b5925cc7f5fbe004808a.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_f39de198d77b2280578a91ef496965a5.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_a8f2eac01375f121181bd94e9d680416.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_bab985d34f6c0143a1d7cc26cf78e31a.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_c4f447b91ae2b1efca4b5b0b29bcdca8.jpg',
                'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_9ba94557bfeff3226e230ae1a481dea6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_d9bdfba243dcfd00d68e0e2de43fc89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_822c55e8efe49b90b94fdabb9db155d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_218013d6f99b7198d84679ebb178fc28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_0a5e5ab6941d34b6103471c10dfcbeae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_2e96f27941a84b4a05244d65a162d443.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_cdba4fa9396386a94f7a2566f7b63c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_dd936511945bb7848faf9a59c1e1f9f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_e6f178dd7f3147ecc28485adc58e87a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_59257c222c750b698d86be0872007208.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_ee4ae3a056b1b5925cc7f5fbe004808a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_f39de198d77b2280578a91ef496965a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_a8f2eac01375f121181bd94e9d680416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_bab985d34f6c0143a1d7cc26cf78e31a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_c4f447b91ae2b1efca4b5b0b29bcdca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca493fb-207a-5221-949c-696645256dd4/5ca493fb-207a-5221-949c-696645256dd4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa44ca6a5966973fc48f581492baecf/pa/LB26900_9ba94557bfeff3226e230ae1a481dea6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2021}
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-01-28 10:02:51 [auto1.it] INFO: Saving data for LB26900: {'created_time': 1769594571.696253, 'last_price_update_time': 1769594571.696268, 'auction_closing_time': 1769705773.0}
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB26900') HTTP/1.1" 204 0
2026-01-28 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f49ffad-86a6-5b8b-9032-23c10f64f845 with identifier: AJ95736
2026-01-28 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f49ffad-86a6-5b8b-9032-23c10f64f845 with identifier: AJ95736
2026-01-28 10:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f49ffad-86a6-5b8b-9032-23c10f64f845 with identifier: AJ95736 to the API
2026-01-28 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ95736>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:19:52Z',
 'fuel_type': 'diesel',
 'id': '8f49ffad-86a6-5b8b-9032-23c10f64f845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ95736',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 147146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Business AWD',
 'transmission': 'automatic',
 'trim': 'Business AWD',
 'year': 2018}
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ95736%27 HTTP/1.1" 200 None
2026-01-28 10:02:53 [auto1.it] INFO: Saving data for AJ95736: {'auction_closing_time': 1769703592.0, 'created_time': 1768421217.420818, 'last_price_update_time': 1769594573.475682}
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ95736') HTTP/1.1" 204 0
2026-01-28 10:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with identifier: JU28816
2026-01-28 10:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with identifier: JU28816
2026-01-28 10:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c5747d6-84f6-54d9-ba94-d7d4b3844316 with identifier: JU28816 to the API
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU28816>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:01:46Z',
 'fuel_type': 'diesel',
 'id': '8c5747d6-84f6-54d9-ba94-d7d4b3844316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU28816',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 102605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2019}
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28816%27 HTTP/1.1" 200 None
2026-01-28 10:02:53 [auto1.it] INFO: Saving data for JU28816: {'auction_closing_time': 1769702506.0, 'created_time': 1768420927.668997, 'last_price_update_time': 1769594573.7801}
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU28816') HTTP/1.1" 204 0
2026-01-28 10:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 10:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 10:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee13790>
2026-01-28 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg saved to cache
2026-01-28 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC27393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB74870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b9de532-2994-562c-8baa-a660cc5551c7 with identifier: UH74677
2026-01-28 10:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b9de532-2994-562c-8baa-a660cc5551c7 with scrape type 2
2026-01-28 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b9de532-2994-562c-8baa-a660cc5551c7 with scrape type 2
2026-01-28 10:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b9de532-2994-562c-8baa-a660cc5551c7, identifier: UH74677
2026-01-28 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b9de532-2994-562c-8baa-a660cc5551c7 with identifier: UH74677
2026-01-28 10:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b9de532-2994-562c-8baa-a660cc5551c7 with identifier: UH74677
2026-01-28 10:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165042 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165042
2026-01-28 10:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5b9de532-2994-562c-8baa-a660cc5551c7 spider: auto1.it
2026-01-28 10:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5b9de532-2994-562c-8baa-a660cc5551c7 due to rule: high_mileage_for_country.json, error: 165042 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165042
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:06:47Z',
 'fuel_type': 'diesel',
 'id': '5b9de532-2994-562c-8baa-a660cc5551c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH74677',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': '3er',
 'odometer': 165042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH74677%27 HTTP/1.1" 200 None
2026-01-28 10:02:54 [auto1.it] INFO: Saving data for UH74677: {'auction_closing_time': 1769702807.0, 'created_time': 1768334546.727284, 'last_price_update_time': 1769594574.638156}
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH74677') HTTP/1.1" 204 0
2026-01-28 10:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef7f0d0>
2026-01-28 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg saved to cache
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee323150>
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_675d7b98703877ae68a221e9c63f68ea.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_675d7b98703877ae68a221e9c63f68ea.jpg saved to cache
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee433850>
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg saved to cache
2026-01-28 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4303d0>
2026-01-28 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg saved to cache
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU61741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB91559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC36763> (referer: https://www.auto1.com/v1/car-details-view/DC36763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR94610> (referer: https://www.auto1.com/v1/car-details-view/ZR94610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee266410>
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg saved to cache
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee46ed10>
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F1b%252F081b205ea10699d6924bf4dee555ab09%252Fpa%252FRC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg saved to cache
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb
2026-01-28 10:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb, skipping ID generation
2026-01-28 10:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with scrape type 1
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb from tracking dictionaries
2026-01-28 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb sending to next pipeline
2026-01-28 10:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb, identifier: RC65604
2026-01-28 10:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 10:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 10:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 10:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee323750>
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg saved to cache
2026-01-28 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with identifier: RC65604
2026-01-28 10:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with identifier: RC65604
2026-01-28 10:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f60f5fb-0fe9-5818-917a-bebdd1c38ddb with identifier: RC65604 to the API
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:53:36Z',
 'fuel_type': 'diesel',
 'id': '8f60f5fb-0fe9-5818-917a-bebdd1c38ddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC65604',
 'listing': 'auction',
 'location': 'IT, Desenzano del Garda',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 121905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_27f34852583bada59d0cb3437d54e0d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_ec09d90258054ab7091bde4b03a7cb70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_95c3710eb7d449dc11e59644987f0126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_2894ab96d4210fc91dff214602ce8b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_43e84acc108fd5c5c885a2bde3418c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0904993bebe96728b935bc0dc76048a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_61566abe8b82dc6d9b34e935f2855c5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_c7d62a4ae3efa4757e4db43f5e6cecfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_8ec6585d115e678020e612b2a5f5f730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_911c0f9a0967732ca629c52bf64e2f2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_f85ef082b0ec65f99e6e4d042ce5e8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0d6f8f10ee088159ed0b6454bdba1dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_07b6126b0bc2015dc1cca0598e896d43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_36fda31860820b2204fc04ae8b3a5ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f60f5fb-0fe9-5818-917a-bebdd1c38ddb/8f60f5fb-0fe9-5818-917a-bebdd1c38ddb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/1b/081b205ea10699d6924bf4dee555ab09/pa/RC65604_0331a445d88d4d67f23c27b1b07ff64f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC65604%27 HTTP/1.1" 200 None
2026-01-28 10:02:57 [auto1.it] INFO: Saving data for RC65604: {'created_time': 1769594577.901099, 'last_price_update_time': 1769594577.90111, 'auction_closing_time': 1769705616.0}
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC65604') HTTP/1.1" 204 0
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3ca1d0>
2026-01-28 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg saved to cache
2026-01-28 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a7ca0c-6a73-5111-9b8b-0aae87765afc with identifier: DC36763
2026-01-28 10:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a7ca0c-6a73-5111-9b8b-0aae87765afc with scrape type 2
2026-01-28 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a7ca0c-6a73-5111-9b8b-0aae87765afc with scrape type 2
2026-01-28 10:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6a7ca0c-6a73-5111-9b8b-0aae87765afc, identifier: DC36763
2026-01-28 10:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f917c6-cce4-506d-a981-75575ceb1387 with identifier: ZR94610
2026-01-28 10:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f917c6-cce4-506d-a981-75575ceb1387 with scrape type 2
2026-01-28 10:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f917c6-cce4-506d-a981-75575ceb1387 with scrape type 2
2026-01-28 10:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3f917c6-cce4-506d-a981-75575ceb1387, identifier: ZR94610
2026-01-28 10:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_57a89376c2e6622ed9c5b3e03430f034.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6a7ca0c-6a73-5111-9b8b-0aae87765afc with identifier: DC36763
2026-01-28 10:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6a7ca0c-6a73-5111-9b8b-0aae87765afc with identifier: DC36763
2026-01-28 10:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6a7ca0c-6a73-5111-9b8b-0aae87765afc with identifier: DC36763 to the API
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC36763>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:24:09Z',
 'fuel_type': 'petrol',
 'id': 'e6a7ca0c-6a73-5111-9b8b-0aae87765afc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC36763',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 20166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC36763%27 HTTP/1.1" 200 None
2026-01-28 10:02:58 [auto1.it] INFO: Saving data for DC36763: {'auction_closing_time': 1769703849.0, 'created_time': 1768334442.714491, 'last_price_update_time': 1769594578.95501}
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC36763') HTTP/1.1" 204 0
2026-01-28 10:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3f917c6-cce4-506d-a981-75575ceb1387 with identifier: ZR94610
2026-01-28 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-28 10:02:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3f917c6-cce4-506d-a981-75575ceb1387 with identifier: ZR94610
2026-01-28 10:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3f917c6-cce4-506d-a981-75575ceb1387 with identifier: ZR94610 to the API
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZR94610>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:59Z',
 'fuel_type': 'petrol',
 'id': 'f3f917c6-cce4-506d-a981-75575ceb1387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR94610',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2019}
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR94610%27 HTTP/1.1" 200 None
2026-01-28 10:02:59 [auto1.it] INFO: Saving data for ZR94610: {'auction_closing_time': 1769705099.0, 'created_time': 1768377704.921365, 'last_price_update_time': 1769594579.501935}
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR94610') HTTP/1.1" 204 0
2026-01-28 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL82578> (referer: https://www.auto1.com/v1/car-details-view/HL82578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee57df10>
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_57a89376c2e6622ed9c5b3e03430f034.jpg') HTTP/1.1" 204 0
2026-01-28 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_57a89376c2e6622ed9c5b3e03430f034.jpg saved to cache
2026-01-28 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aab513b-28d4-540f-a9d8-328f25ed5095 with identifier: HL82578
2026-01-28 10:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aab513b-28d4-540f-a9d8-328f25ed5095 with scrape type 2
2026-01-28 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aab513b-28d4-540f-a9d8-328f25ed5095 with scrape type 2
2026-01-28 10:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9aab513b-28d4-540f-a9d8-328f25ed5095, identifier: HL82578
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40e6190>
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc7%252Ff0c785be5904e90d5f11b59ad429905e%252Fpa%252FEA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg saved to cache
2026-01-28 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b0de792-5bce-52c8-aaae-95e89c58f244
2026-01-28 10:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b0de792-5bce-52c8-aaae-95e89c58f244, skipping ID generation
2026-01-28 10:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0de792-5bce-52c8-aaae-95e89c58f244 with scrape type 1
2026-01-28 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7b0de792-5bce-52c8-aaae-95e89c58f244 from tracking dictionaries
2026-01-28 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b0de792-5bce-52c8-aaae-95e89c58f244 sending to next pipeline
2026-01-28 10:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b0de792-5bce-52c8-aaae-95e89c58f244, identifier: EA80460
2026-01-28 10:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9aab513b-28d4-540f-a9d8-328f25ed5095 with identifier: HL82578
2026-01-28 10:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9aab513b-28d4-540f-a9d8-328f25ed5095 with identifier: HL82578
2026-01-28 10:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9aab513b-28d4-540f-a9d8-328f25ed5095 with identifier: HL82578 to the API
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL82578>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:09:59Z',
 'fuel_type': 'gas',
 'id': '9aab513b-28d4-540f-a9d8-328f25ed5095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL82578',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'DR',
 'model': 'DR 5.0',
 'odometer': 42011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 5.0 1.5 LPG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL82578%27 HTTP/1.1" 200 None
2026-01-28 10:03:00 [auto1.it] INFO: Saving data for HL82578: {'auction_closing_time': 1769702999.0, 'created_time': 1768853047.269165, 'last_price_update_time': 1769594580.797514}
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL82578') HTTP/1.1" 204 0
2026-01-28 10:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b0de792-5bce-52c8-aaae-95e89c58f244 with identifier: EA80460
2026-01-28 10:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b0de792-5bce-52c8-aaae-95e89c58f244 with identifier: EA80460
2026-01-28 10:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b0de792-5bce-52c8-aaae-95e89c58f244 with identifier: EA80460 to the API
2026-01-28 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:35:40Z',
 'fuel_type': 'petrol',
 'id': '7b0de792-5bce-52c8-aaae-95e89c58f244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA80460',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 60097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839407,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_90040ca795fac18f38a73b3a90e5633e.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839407,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_968f385a2ee1d87ddd73217f9dcd31bd.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 892471,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_08770e3aaff481b3c72556c6080710f5.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710722,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_53b8bf902483543a1ebbe259eed9c48c.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790958,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_57a89376c2e6622ed9c5b3e03430f034.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 917911,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_417c982a0cd62c0bad2c5c156909c5d1.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841771,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b3bf78bbaeeea4a16df3d6910483bc16.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671262,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_af93bdcdcb0f3a87180e7c9bc3a0577e.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603425,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_675d7b98703877ae68a221e9c63f68ea.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273060,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_23ea0db3a0cde7149a17d298a6d7d672.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521754,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_f14e9b5dd0ab15eef54ca7148a86cd82.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140689,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_2a95aad745c4a8ab754169efe5d3b66e.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0de792-5bce-52c8-aaae-95e89c58f244/7b0de792-5bce-52c8-aaae-95e89c58f244_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207957,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c7/f0c785be5904e90d5f11b59ad429905e/pa/EA80460_b0061ed48e73d9d4c59d50f6808e26a6.jpg',
             'Width': 1600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2021}
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA80460%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [auto1.it] INFO: Saving data for EA80460: {'created_time': 1769594581.246149, 'last_price_update_time': 1769594581.246164, 'auction_closing_time': 1769704540.0}
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA80460') HTTP/1.1" 204 0
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG20319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR06591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF20294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL40875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ25178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB23984> (referer: https://www.auto1.com/v1/car-details-view/CB23984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ55749> (referer: https://www.auto1.com/v1/car-details-view/DZ55749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_45a6670c6d144a94981503cae149d125.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_24516de8f3e7bd3ac108da7417587e16.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_96ebba9c8255c6343222ba3f67985170.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_239a7a79735b2b60a97990116f84af22.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_de89c4a6006ebbcc1e946483de8854a0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147083d9-18e5-5174-b90d-ccaaa0cc876e with identifier: CB23984
2026-01-28 10:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147083d9-18e5-5174-b90d-ccaaa0cc876e with scrape type 1
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 147083d9-18e5-5174-b90d-ccaaa0cc876e
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_8a7e42c72494f5a2c64dd364a95cea12.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8a7e42c72494f5a2c64dd364a95cea12.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_7981308d343fefe433b0b8355f229cdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_7981308d343fefe433b0b8355f229cdd.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_92598dcea3b6c228afaaa8ec8426838f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_92598dcea3b6c228afaaa8ec8426838f.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_db39e3d7afdfdbee7e19ce53bdca5b3e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_db39e3d7afdfdbee7e19ce53bdca5b3e.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_8e521cf04343129afc98d76d409231ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8e521cf04343129afc98d76d409231ce.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_a7c4a4aa13e07739df1493d95b5e2897.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_a7c4a4aa13e07739df1493d95b5e2897.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_b2ec825f0042d22f3fad54067a5debb6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_b2ec825f0042d22f3fad54067a5debb6.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_9a96f33051a00de8cad8956143a10635.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9a96f33051a00de8cad8956143a10635.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_20297f40fa7cbcff2158f95ba407f60c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_20297f40fa7cbcff2158f95ba407f60c.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_30c855d71359323eb364589d58e811b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_30c855d71359323eb364589d58e811b7.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_f7c01f56612caf9abd2743853076dda5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_f7c01f56612caf9abd2743853076dda5.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_9cfae24dc3496984962c8cb073c354bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9cfae24dc3496984962c8cb073c354bd.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_24cd7dfd6a8d5357575b5ad305f6212d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_24cd7dfd6a8d5357575b5ad305f6212d.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_9ea50184ee5f6881d745f1ffbb0c9965.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9ea50184ee5f6881d745f1ffbb0c9965.jpg already downloaded
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F28%252Fdb28265f02dd9ce3d13ac8424ff1cb81%252Fpa%252FCB23984_d9cdf396c495dce70f343c1bed7b0a2d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_d9cdf396c495dce70f343c1bed7b0a2d.jpg already downloaded
2026-01-28 10:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 147083d9-18e5-5174-b90d-ccaaa0cc876e, identifier: CB23984
2026-01-28 10:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f200de3d-1929-5be4-81f8-07a9c6de9ae7 with identifier: DZ55749
2026-01-28 10:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f200de3d-1929-5be4-81f8-07a9c6de9ae7 with scrape type 2
2026-01-28 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f200de3d-1929-5be4-81f8-07a9c6de9ae7 with scrape type 2
2026-01-28 10:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f200de3d-1929-5be4-81f8-07a9c6de9ae7, identifier: DZ55749
2026-01-28 10:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 147083d9-18e5-5174-b90d-ccaaa0cc876e with identifier: CB23984
2026-01-28 10:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 147083d9-18e5-5174-b90d-ccaaa0cc876e with identifier: CB23984
2026-01-28 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151919 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151919
2026-01-28 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 147083d9-18e5-5174-b90d-ccaaa0cc876e spider: auto1.it
2026-01-28 10:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 147083d9-18e5-5174-b90d-ccaaa0cc876e due to rule: high_mileage_for_country.json, error: 151919 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151919
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:50:27Z',
 'fuel_type': 'diesel',
 'id': '147083d9-18e5-5174-b90d-ccaaa0cc876e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB23984',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 151919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8a7e42c72494f5a2c64dd364a95cea12.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_7981308d343fefe433b0b8355f229cdd.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_92598dcea3b6c228afaaa8ec8426838f.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_db39e3d7afdfdbee7e19ce53bdca5b3e.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8e521cf04343129afc98d76d409231ce.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_a7c4a4aa13e07739df1493d95b5e2897.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_b2ec825f0042d22f3fad54067a5debb6.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9a96f33051a00de8cad8956143a10635.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_20297f40fa7cbcff2158f95ba407f60c.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_30c855d71359323eb364589d58e811b7.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_f7c01f56612caf9abd2743853076dda5.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9cfae24dc3496984962c8cb073c354bd.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_24cd7dfd6a8d5357575b5ad305f6212d.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9ea50184ee5f6881d745f1ffbb0c9965.jpg',
                'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_d9cdf396c495dce70f343c1bed7b0a2d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8a7e42c72494f5a2c64dd364a95cea12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_7981308d343fefe433b0b8355f229cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_92598dcea3b6c228afaaa8ec8426838f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_db39e3d7afdfdbee7e19ce53bdca5b3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_8e521cf04343129afc98d76d409231ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_a7c4a4aa13e07739df1493d95b5e2897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_b2ec825f0042d22f3fad54067a5debb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9a96f33051a00de8cad8956143a10635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_20297f40fa7cbcff2158f95ba407f60c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_30c855d71359323eb364589d58e811b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_f7c01f56612caf9abd2743853076dda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9cfae24dc3496984962c8cb073c354bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_24cd7dfd6a8d5357575b5ad305f6212d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_9ea50184ee5f6881d745f1ffbb0c9965.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_147083d9-18e5-5174-b90d-ccaaa0cc876e/147083d9-18e5-5174-b90d-ccaaa0cc876e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/28/db28265f02dd9ce3d13ac8424ff1cb81/pa/CB23984_d9cdf396c495dce70f343c1bed7b0a2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB23984%27 HTTP/1.1" 200 None
2026-01-28 10:03:02 [auto1.it] INFO: Saving data for CB23984: {'created_time': 1769594582.194809, 'last_price_update_time': 1769594582.19482, 'auction_closing_time': 1769705427.0}
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB23984') HTTP/1.1" 204 0
2026-01-28 10:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f200de3d-1929-5be4-81f8-07a9c6de9ae7 with identifier: DZ55749
2026-01-28 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f200de3d-1929-5be4-81f8-07a9c6de9ae7 with identifier: DZ55749
2026-01-28 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173074 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173074
2026-01-28 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f200de3d-1929-5be4-81f8-07a9c6de9ae7 spider: auto1.it
2026-01-28 10:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f200de3d-1929-5be4-81f8-07a9c6de9ae7 due to rule: high_mileage_for_country.json, error: 173074 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173074
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 341,
 'expiration_date': '2026-01-29T16:59:45Z',
 'fuel_type': 'diesel',
 'id': 'f200de3d-1929-5be4-81f8-07a9c6de9ae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ55749',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'SQ5 Sportback',
 'odometer': 173074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 Sportback 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ55749%27 HTTP/1.1" 200 None
2026-01-28 10:03:02 [auto1.it] INFO: Saving data for DZ55749: {'auction_closing_time': 1769705985.0, 'created_time': 1769458137.398827, 'last_price_update_time': 1769594582.477512}
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DZ55749') HTTP/1.1" 204 0
2026-01-28 10:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe4950>
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_45a6670c6d144a94981503cae149d125.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_45a6670c6d144a94981503cae149d125.jpg saved to cache
2026-01-28 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef1e710>
2026-01-28 10:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_24516de8f3e7bd3ac108da7417587e16.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_24516de8f3e7bd3ac108da7417587e16.jpg saved to cache
2026-01-28 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee515310>
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_96ebba9c8255c6343222ba3f67985170.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_96ebba9c8255c6343222ba3f67985170.jpg saved to cache
2026-01-28 10:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5e8090>
2026-01-28 10:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_239a7a79735b2b60a97990116f84af22.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_239a7a79735b2b60a97990116f84af22.jpg saved to cache
2026-01-28 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee570150>
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_de89c4a6006ebbcc1e946483de8854a0.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_de89c4a6006ebbcc1e946483de8854a0.jpg saved to cache
2026-01-28 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU61741> (referer: https://www.auto1.com/v1/car-details-view/VU61741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC58138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC27393> (referer: https://www.auto1.com/v1/car-details-view/WC27393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ17961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB91559> (referer: https://www.auto1.com/v1/car-details-view/MB91559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB74870> (referer: https://www.auto1.com/v1/car-details-view/LB74870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_49d81597ca058530acdccb6500634b64.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7d397d7e5503c93d4c4c666735e60af1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3397dc25-93e0-5706-9e00-bce190e52b6c with identifier: VU61741
2026-01-28 10:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3397dc25-93e0-5706-9e00-bce190e52b6c with scrape type 2
2026-01-28 10:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3397dc25-93e0-5706-9e00-bce190e52b6c with scrape type 2
2026-01-28 10:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3397dc25-93e0-5706-9e00-bce190e52b6c, identifier: VU61741
2026-01-28 10:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3397dc25-93e0-5706-9e00-bce190e52b6c with identifier: VU61741
2026-01-28 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3397dc25-93e0-5706-9e00-bce190e52b6c with identifier: VU61741
2026-01-28 10:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3397dc25-93e0-5706-9e00-bce190e52b6c with identifier: VU61741 to the API
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU61741>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:28:16Z',
 'fuel_type': 'hybrid',
 'id': '3397dc25-93e0-5706-9e00-bce190e52b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU61741',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 11203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Austral 1.2 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2025}
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU61741%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [auto1.it] INFO: Saving data for VU61741: {'auction_closing_time': 1769704096.0, 'created_time': 1767902653.239041, 'last_price_update_time': 1769594585.089683}
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU61741') HTTP/1.1" 204 0
2026-01-28 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7ebaca697da72898e13b1e887bfe4483.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e with identifier: WC27393
2026-01-28 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e with scrape type 1
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_c521f86deb657843655684682a1b92c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_c521f86deb657843655684682a1b92c3.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_0e4b883e7f79185eac3b619084f6e7f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_0e4b883e7f79185eac3b619084f6e7f4.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_775dbc871053a9fa0594df663fcc3af2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_775dbc871053a9fa0594df663fcc3af2.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_a35dcd1817fcc8900ba3bccaa556b99b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_a35dcd1817fcc8900ba3bccaa556b99b.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_dfb28fcbc9f9a13f3b6e2123391c369c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_dfb28fcbc9f9a13f3b6e2123391c369c.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_f368385fbea6fe2c2439ef8af1bdff8a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f368385fbea6fe2c2439ef8af1bdff8a.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_618d783a7ddf35b7ed2d96937f239848.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_618d783a7ddf35b7ed2d96937f239848.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_17948929dab962af447254a80fc7033c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_17948929dab962af447254a80fc7033c.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_ef7f8903319b1a605f8aa39763421293.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_ef7f8903319b1a605f8aa39763421293.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_f5ae73bbbf5803d348750cbe518e3b5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f5ae73bbbf5803d348750cbe518e3b5d.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_48673f52efcdff9008929f46d4144226.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_48673f52efcdff9008929f46d4144226.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_cd899fe12705ceb6756111b295bbf522.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_cd899fe12705ceb6756111b295bbf522.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F63%252F4463be938a52ac7ae17cbd805d29890d%252Fpa%252FWC27393_427cf2a4cec959ee38781bc3c5cddc37.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_427cf2a4cec959ee38781bc3c5cddc37.jpg already downloaded
2026-01-28 10:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e, identifier: WC27393
2026-01-28 10:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-01-28 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ca629b-700c-5db0-bc90-1c02e9813c04 with scrape type 1
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 65ca629b-700c-5db0-bc90-1c02e9813c04
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_eb2ddfffac90e203be62e7ad4fbe8d22.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eb2ddfffac90e203be62e7ad4fbe8d22.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_eebd4617a78d63ca8f8bf1eb4c1ae5cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eebd4617a78d63ca8f8bf1eb4c1ae5cf.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_fafb0359ac0b6774d9314cc6e5c469ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_fafb0359ac0b6774d9314cc6e5c469ef.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_90519bca14f412dbeb1cb76f92ec404c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_90519bca14f412dbeb1cb76f92ec404c.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_68fdce0f569d97f98cad753ed60a1297.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_68fdce0f569d97f98cad753ed60a1297.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_e97cdf6636f2f955410ad0baa18b2e43.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_e97cdf6636f2f955410ad0baa18b2e43.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_002e74f8193f2cd572c980666cb1d544.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_002e74f8193f2cd572c980666cb1d544.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_83edb9a53572928b6c967f0ab0207ec7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_83edb9a53572928b6c967f0ab0207ec7.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_c23bd84cc6cb7c98f5984e6eaffc4e69.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_c23bd84cc6cb7c98f5984e6eaffc4e69.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_9c5313ccc7825ebba55e40a1af14896d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9c5313ccc7825ebba55e40a1af14896d.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_9546ca47d431e2580c6a1dd508a70962.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9546ca47d431e2580c6a1dd508a70962.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_ea004f78dbdaea643c423e5a9a9e0cc8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_ea004f78dbdaea643c423e5a9a9e0cc8.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_793fcb4d2782702da3d51375cf472c41.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_793fcb4d2782702da3d51375cf472c41.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_53aad3c097bf31a4cd940f5bf33582fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_53aad3c097bf31a4cd940f5bf33582fb.jpg already downloaded
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252Fba%252F9bba3a83fd973dbfed235f78d4238ff4%252Fpa%252FMB91559_b3762d74135dbf45c293fbd351005a48.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_b3762d74135dbf45c293fbd351005a48.jpg already downloaded
2026-01-28 10:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65ca629b-700c-5db0-bc90-1c02e9813c04, identifier: MB91559
2026-01-28 10:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 with identifier: LB74870
2026-01-28 10:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 with scrape type 2
2026-01-28 10:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 with scrape type 2
2026-01-28 10:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6, identifier: LB74870
2026-01-28 10:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee97950>
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_49d81597ca058530acdccb6500634b64.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_49d81597ca058530acdccb6500634b64.jpg saved to cache
2026-01-28 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee54ac50>
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg saved to cache
2026-01-28 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee97490>
2026-01-28 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_7d397d7e5503c93d4c4c666735e60af1.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7d397d7e5503c93d4c4c666735e60af1.jpg saved to cache
2026-01-28 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee548b50>
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg saved to cache
2026-01-28 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e with identifier: WC27393
2026-01-28 10:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e with identifier: WC27393
2026-01-28 10:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e with identifier: WC27393 to the API
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC27393>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2026-01-29T16:37:46Z',
 'fuel_type': 'petrol',
 'id': 'cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC27393',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 33792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_c521f86deb657843655684682a1b92c3.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_0e4b883e7f79185eac3b619084f6e7f4.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_775dbc871053a9fa0594df663fcc3af2.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_a35dcd1817fcc8900ba3bccaa556b99b.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_dfb28fcbc9f9a13f3b6e2123391c369c.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f368385fbea6fe2c2439ef8af1bdff8a.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_618d783a7ddf35b7ed2d96937f239848.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_17948929dab962af447254a80fc7033c.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_ef7f8903319b1a605f8aa39763421293.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f5ae73bbbf5803d348750cbe518e3b5d.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_48673f52efcdff9008929f46d4144226.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_cd899fe12705ceb6756111b295bbf522.jpg',
                'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_427cf2a4cec959ee38781bc3c5cddc37.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_c521f86deb657843655684682a1b92c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_0e4b883e7f79185eac3b619084f6e7f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_775dbc871053a9fa0594df663fcc3af2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_a35dcd1817fcc8900ba3bccaa556b99b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_dfb28fcbc9f9a13f3b6e2123391c369c.jpg',
             'Width': 774},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f368385fbea6fe2c2439ef8af1bdff8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821352,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_618d783a7ddf35b7ed2d96937f239848.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_17948929dab962af447254a80fc7033c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_ef7f8903319b1a605f8aa39763421293.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_f5ae73bbbf5803d348750cbe518e3b5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4088072,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_48673f52efcdff9008929f46d4144226.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_cd899fe12705ceb6756111b295bbf522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e/cafe29b5-f305-5c5e-ae5c-f74aebcfcb2e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/63/4463be938a52ac7ae17cbd805d29890d/pa/WC27393_427cf2a4cec959ee38781bc3c5cddc37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.0 T-GDI Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC27393%27 HTTP/1.1" 200 None
2026-01-28 10:03:07 [auto1.it] INFO: Saving data for WC27393: {'created_time': 1769594587.859117, 'last_price_update_time': 1769594587.859132, 'auction_closing_time': 1769704666.0}
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC27393') HTTP/1.1" 204 0
2026-01-28 10:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-01-28 10:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-01-28 10:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143630 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143630
2026-01-28 10:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 65ca629b-700c-5db0-bc90-1c02e9813c04 spider: auto1.it
2026-01-28 10:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 65ca629b-700c-5db0-bc90-1c02e9813c04 due to rule: high_mileage_for_make.json, error: 143630 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143630
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:29:56Z',
 'fuel_type': 'diesel',
 'id': '65ca629b-700c-5db0-bc90-1c02e9813c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB91559',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 143630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eb2ddfffac90e203be62e7ad4fbe8d22.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eebd4617a78d63ca8f8bf1eb4c1ae5cf.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_fafb0359ac0b6774d9314cc6e5c469ef.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_90519bca14f412dbeb1cb76f92ec404c.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_68fdce0f569d97f98cad753ed60a1297.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_e97cdf6636f2f955410ad0baa18b2e43.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_002e74f8193f2cd572c980666cb1d544.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_83edb9a53572928b6c967f0ab0207ec7.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_c23bd84cc6cb7c98f5984e6eaffc4e69.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9c5313ccc7825ebba55e40a1af14896d.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9546ca47d431e2580c6a1dd508a70962.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_ea004f78dbdaea643c423e5a9a9e0cc8.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_793fcb4d2782702da3d51375cf472c41.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_53aad3c097bf31a4cd940f5bf33582fb.jpg',
                'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_b3762d74135dbf45c293fbd351005a48.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eb2ddfffac90e203be62e7ad4fbe8d22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_eebd4617a78d63ca8f8bf1eb4c1ae5cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_fafb0359ac0b6774d9314cc6e5c469ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_90519bca14f412dbeb1cb76f92ec404c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_68fdce0f569d97f98cad753ed60a1297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_e97cdf6636f2f955410ad0baa18b2e43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2566953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_002e74f8193f2cd572c980666cb1d544.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_83edb9a53572928b6c967f0ab0207ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_c23bd84cc6cb7c98f5984e6eaffc4e69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9c5313ccc7825ebba55e40a1af14896d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_9546ca47d431e2580c6a1dd508a70962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_ea004f78dbdaea643c423e5a9a9e0cc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_793fcb4d2782702da3d51375cf472c41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_53aad3c097bf31a4cd940f5bf33582fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ca629b-700c-5db0-bc90-1c02e9813c04/65ca629b-700c-5db0-bc90-1c02e9813c04_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/ba/9bba3a83fd973dbfed235f78d4238ff4/pa/MB91559_b3762d74135dbf45c293fbd351005a48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D165 Mild-Hybrid R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2022}
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-01-28 10:03:08 [auto1.it] INFO: Saving data for MB91559: {'created_time': 1769594588.137297, 'last_price_update_time': 1769594588.137313, 'auction_closing_time': 1769704196.0}
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB91559') HTTP/1.1" 204 0
2026-01-28 10:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 with identifier: LB74870
2026-01-28 10:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 with identifier: LB74870
2026-01-28 10:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172367 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172367
2026-01-28 10:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 spider: auto1.it
2026-01-28 10:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 00ba41b4-2c0f-54be-9129-4ea9ed1550f6 due to rule: high_mileage_for_country.json, error: 172367 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172367
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:45:31Z',
 'fuel_type': 'petrol',
 'id': '00ba41b4-2c0f-54be-9129-4ea9ed1550f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB74870',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 172367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 App Mode Blue',
 'transmission': 'manual',
 'trim': 'App Mode Blue',
 'year': 2019}
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB74870%27 HTTP/1.1" 200 None
2026-01-28 10:03:08 [auto1.it] INFO: Saving data for LB74870: {'auction_closing_time': 1769705131.0, 'created_time': 1768334434.577426, 'last_price_update_time': 1769594588.395909}
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB74870') HTTP/1.1" 204 0
2026-01-28 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN71462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM11522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeedb250>
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg saved to cache
2026-01-28 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee9dfd0>
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7ebaca697da72898e13b1e887bfe4483.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7ebaca697da72898e13b1e887bfe4483.jpg saved to cache
2026-01-28 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES44570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_2ef5820e176b70b503819be8f73c2ba3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef685d0>
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_2ef5820e176b70b503819be8f73c2ba3.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_2ef5820e176b70b503819be8f73c2ba3.jpg saved to cache
2026-01-28 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR06591> (referer: https://www.auto1.com/v1/car-details-view/MR06591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL40875> (referer: https://www.auto1.com/v1/car-details-view/YL40875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ25178> (referer: https://www.auto1.com/v1/car-details-view/UZ25178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF20294> (referer: https://www.auto1.com/v1/car-details-view/JF20294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG20319> (referer: https://www.auto1.com/v1/car-details-view/KG20319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeedb790>
2026-01-28 10:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg saved to cache
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22a310>
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F71%252F4271bf1049c99c24ad369c7afb74dff7%252Fpa%252FYY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg saved to cache
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cc51c1c-487a-5916-8b01-97da479b74ce
2026-01-28 10:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc51c1c-487a-5916-8b01-97da479b74ce, skipping ID generation
2026-01-28 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc51c1c-487a-5916-8b01-97da479b74ce with scrape type 1
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cc51c1c-487a-5916-8b01-97da479b74ce from tracking dictionaries
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cc51c1c-487a-5916-8b01-97da479b74ce sending to next pipeline
2026-01-28 10:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cc51c1c-487a-5916-8b01-97da479b74ce, identifier: YY00281
2026-01-28 10:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-01-28 10:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cc51c1c-487a-5916-8b01-97da479b74ce with identifier: YY00281
2026-01-28 10:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-28 10:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0cc51c1c-487a-5916-8b01-97da479b74ce spider: auto1.it
2026-01-28 10:03:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0cc51c1c-487a-5916-8b01-97da479b74ce due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:25:34Z',
 'fuel_type': 'petrol',
 'id': '0cc51c1c-487a-5916-8b01-97da479b74ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY00281',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 14143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_4a8a6607c65cd5951e8210fae8dc909e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_c87f65ef4e7c83bb29206db742d4a63c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_5760d0d207e8fcc6d0f974730636ae4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_239a7a79735b2b60a97990116f84af22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_bdc07f93a5159b9f7a81bac0b4c89a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_de89c4a6006ebbcc1e946483de8854a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_1573fdb603a677775e537b3f496fe400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_0d2ffda0ef6ad61201cf647188d60524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_f3a1b198a6890dcf325b3fe1eadc8792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_d0112f7527e23d359131907e5b34bfe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_9cd022bc7da9d39e862e406d168e8738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_ea0b97a0393ccad0b64ee48e38572175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_6648b65daad3b423d172e85734e83160.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_decc8ab4ed4da7913e4e7d8a14ca1da1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc51c1c-487a-5916-8b01-97da479b74ce/0cc51c1c-487a-5916-8b01-97da479b74ce_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/71/4271bf1049c99c24ad369c7afb74dff7/pa/YY00281_7d476b6b6b480185b0d159257144fcef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-01-28 10:03:10 [auto1.it] INFO: Saving data for YY00281: {'auction_closing_time': 1769703934.0, 'created_time': 1769594590.674337, 'last_price_update_time': 1769594590.674349}
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY00281') HTTP/1.1" 204 0
2026-01-28 10:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF48878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078a0f5f-aec4-58f6-8f84-75582c825d23 with identifier: MR06591
2026-01-28 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a0f5f-aec4-58f6-8f84-75582c825d23 with scrape type 2
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078a0f5f-aec4-58f6-8f84-75582c825d23 with scrape type 2
2026-01-28 10:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 078a0f5f-aec4-58f6-8f84-75582c825d23, identifier: MR06591
2026-01-28 10:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f221de-dcef-5697-a60f-daadd42e5cc5 with identifier: YL40875
2026-01-28 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f221de-dcef-5697-a60f-daadd42e5cc5 with scrape type 2
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f221de-dcef-5697-a60f-daadd42e5cc5 with scrape type 2
2026-01-28 10:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47f221de-dcef-5697-a60f-daadd42e5cc5, identifier: YL40875
2026-01-28 10:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8 with identifier: UZ25178
2026-01-28 10:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8 with scrape type 1
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_28f8cdd22287157825be817d32d24ffa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_28f8cdd22287157825be817d32d24ffa.jpg already downloaded
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_e76446bb051dd55acba67677242de382.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_e76446bb051dd55acba67677242de382.jpg already downloaded
2026-01-28 10:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_73ae9001dee7526538b8a277c83f2b25.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_73ae9001dee7526538b8a277c83f2b25.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_56b63d505e15f46c8ff5f0748d7ade5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_56b63d505e15f46c8ff5f0748d7ade5f.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_12e4bd00f52b2a5a2d770ae5d3f7b27c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_12e4bd00f52b2a5a2d770ae5d3f7b27c.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_84dc338630474e721f7966397d4008d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_84dc338630474e721f7966397d4008d0.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_f0a9b8fd0e431073d1a3f8a08b803c8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_f0a9b8fd0e431073d1a3f8a08b803c8e.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_6eac6fe9701e7b610ea27e284ed1cdfa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_6eac6fe9701e7b610ea27e284ed1cdfa.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_c9c287429310bf8b85b144ddbfb88198.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_c9c287429310bf8b85b144ddbfb88198.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_8de601d3af7e2a26f7b7ee9988c0bfdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_8de601d3af7e2a26f7b7ee9988c0bfdc.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_4114d77b350ee7762d28ba4c876b2fdb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4114d77b350ee7762d28ba4c876b2fdb.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_41e40e0ffbb3bbaa261d6a36e18465bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_41e40e0ffbb3bbaa261d6a36e18465bc.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_923d580d2519c3bc4a4022f52e088872.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_923d580d2519c3bc4a4022f52e088872.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_4dd7e24391492fc30bded24cee641b41.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4dd7e24391492fc30bded24cee641b41.jpg already downloaded
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F62%252Fad62fd3f03a9f5d638432fee1f2b2b1f%252Fpa%252FUZ25178_293ee2b3274c4b5986666de9faf9e5f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_293ee2b3274c4b5986666de9faf9e5f8.jpg already downloaded
2026-01-28 10:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8, identifier: UZ25178
2026-01-28 10:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1341b223-dbf1-5e13-8c2f-612c81a4f53a with identifier: JF20294
2026-01-28 10:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1341b223-dbf1-5e13-8c2f-612c81a4f53a with scrape type 2
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1341b223-dbf1-5e13-8c2f-612c81a4f53a with scrape type 2
2026-01-28 10:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1341b223-dbf1-5e13-8c2f-612c81a4f53a, identifier: JF20294
2026-01-28 10:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf94cb58-dbe2-585d-900e-dfa0f30a3381 with identifier: KG20319
2026-01-28 10:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf94cb58-dbe2-585d-900e-dfa0f30a3381 with scrape type 2
2026-01-28 10:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf94cb58-dbe2-585d-900e-dfa0f30a3381 with scrape type 2
2026-01-28 10:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf94cb58-dbe2-585d-900e-dfa0f30a3381, identifier: KG20319
2026-01-28 10:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 078a0f5f-aec4-58f6-8f84-75582c825d23 with identifier: MR06591
2026-01-28 10:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 078a0f5f-aec4-58f6-8f84-75582c825d23 with identifier: MR06591
2026-01-28 10:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 078a0f5f-aec4-58f6-8f84-75582c825d23 with identifier: MR06591 to the API
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR06591>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:22:12Z',
 'fuel_type': 'petrol',
 'id': '078a0f5f-aec4-58f6-8f84-75582c825d23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR06591',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 106558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2018}
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR06591%27 HTTP/1.1" 200 None
2026-01-28 10:03:11 [auto1.it] INFO: Saving data for MR06591: {'auction_closing_time': 1769703732.0, 'created_time': 1768809689.025239, 'last_price_update_time': 1769594591.900294}
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR06591') HTTP/1.1" 204 0
2026-01-28 10:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47f221de-dcef-5697-a60f-daadd42e5cc5 with identifier: YL40875
2026-01-28 10:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47f221de-dcef-5697-a60f-daadd42e5cc5 with identifier: YL40875
2026-01-28 10:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47f221de-dcef-5697-a60f-daadd42e5cc5 with identifier: YL40875 to the API
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL40875>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:48:11Z',
 'fuel_type': 'hybrid',
 'id': '47f221de-dcef-5697-a60f-daadd42e5cc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL40875',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 13976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active',
 'transmission': 'automatic',
 'trim': '2WD Active',
 'year': 2024}
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL40875%27 HTTP/1.1" 200 None
2026-01-28 10:03:12 [auto1.it] INFO: Saving data for YL40875: {'auction_closing_time': 1769705291.0, 'created_time': 1768853076.535332, 'last_price_update_time': 1769594592.263122}
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL40875') HTTP/1.1" 204 0
2026-01-28 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8 with identifier: UZ25178
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-28 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8 with identifier: UZ25178
2026-01-28 10:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8 with identifier: UZ25178 to the API
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ25178>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:23:33Z',
 'fuel_type': 'diesel',
 'id': 'a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ25178',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 38944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_28f8cdd22287157825be817d32d24ffa.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_e76446bb051dd55acba67677242de382.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_73ae9001dee7526538b8a277c83f2b25.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_56b63d505e15f46c8ff5f0748d7ade5f.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_12e4bd00f52b2a5a2d770ae5d3f7b27c.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_84dc338630474e721f7966397d4008d0.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_f0a9b8fd0e431073d1a3f8a08b803c8e.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_6eac6fe9701e7b610ea27e284ed1cdfa.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_c9c287429310bf8b85b144ddbfb88198.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_8de601d3af7e2a26f7b7ee9988c0bfdc.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4114d77b350ee7762d28ba4c876b2fdb.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_41e40e0ffbb3bbaa261d6a36e18465bc.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_923d580d2519c3bc4a4022f52e088872.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4dd7e24391492fc30bded24cee641b41.jpg',
                'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_293ee2b3274c4b5986666de9faf9e5f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847669,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_28f8cdd22287157825be817d32d24ffa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659789,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_e76446bb051dd55acba67677242de382.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3353950,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_73ae9001dee7526538b8a277c83f2b25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_56b63d505e15f46c8ff5f0748d7ade5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3630329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_12e4bd00f52b2a5a2d770ae5d3f7b27c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_84dc338630474e721f7966397d4008d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_f0a9b8fd0e431073d1a3f8a08b803c8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_6eac6fe9701e7b610ea27e284ed1cdfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_c9c287429310bf8b85b144ddbfb88198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_8de601d3af7e2a26f7b7ee9988c0bfdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4114d77b350ee7762d28ba4c876b2fdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_41e40e0ffbb3bbaa261d6a36e18465bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_923d580d2519c3bc4a4022f52e088872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_4dd7e24391492fc30bded24cee641b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8/a9cc89b0-f0b7-5a9c-b5e8-5af632a339c8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/62/ad62fd3f03a9f5d638432fee1f2b2b1f/pa/UZ25178_293ee2b3274c4b5986666de9faf9e5f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ25178%27 HTTP/1.1" 200 None
2026-01-28 10:03:12 [auto1.it] INFO: Saving data for UZ25178: {'auction_closing_time': 1769703813.0, 'created_time': 1769594592.757209, 'last_price_update_time': 1769594592.75722}
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ25178') HTTP/1.1" 204 0
2026-01-28 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1341b223-dbf1-5e13-8c2f-612c81a4f53a with identifier: JF20294
2026-01-28 10:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1341b223-dbf1-5e13-8c2f-612c81a4f53a with identifier: JF20294
2026-01-28 10:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1341b223-dbf1-5e13-8c2f-612c81a4f53a with identifier: JF20294 to the API
2026-01-28 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JF20294>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 117,
 'expiration_date': '2026-01-29T16:26:14Z',
 'fuel_type': 'petrol',
 'id': '1341b223-dbf1-5e13-8c2f-612c81a4f53a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF20294',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 109887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Basis 2WD',
 'transmission': 'manual',
 'trim': 'Basis 2WD',
 'year': 2019}
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF20294%27 HTTP/1.1" 200 None
2026-01-28 10:03:13 [auto1.it] INFO: Saving data for JF20294: {'auction_closing_time': 1769703974.0, 'created_time': 1769198969.644272, 'last_price_update_time': 1769594593.19119}
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF20294') HTTP/1.1" 204 0
2026-01-28 10:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf94cb58-dbe2-585d-900e-dfa0f30a3381 with identifier: KG20319
2026-01-28 10:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf94cb58-dbe2-585d-900e-dfa0f30a3381 with identifier: KG20319
2026-01-28 10:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187296 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187296
2026-01-28 10:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bf94cb58-dbe2-585d-900e-dfa0f30a3381 spider: auto1.it
2026-01-28 10:03:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bf94cb58-dbe2-585d-900e-dfa0f30a3381 due to rule: high_mileage_for_country.json, error: 187296 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187296
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:42:15Z',
 'fuel_type': 'diesel',
 'id': 'bf94cb58-dbe2-585d-900e-dfa0f30a3381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG20319',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 187296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG20319%27 HTTP/1.1" 200 None
2026-01-28 10:03:13 [auto1.it] INFO: Saving data for KG20319: {'auction_closing_time': 1769704935.0, 'created_time': 1768853007.882773, 'last_price_update_time': 1769594593.438312}
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG20319') HTTP/1.1" 204 0
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_09427b807b455e072994ec72b6076c91.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_6f95786297e88dca9dc39e2174b84be1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC16771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ17961> (referer: https://www.auto1.com/v1/car-details-view/FZ17961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_0032fc7efd7a97dc3186fea96c45660f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7b09231518d32f8efd2ced222c63efd0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_d4fc962297c706cdd20f35c414d7340b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404b790>
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg saved to cache
2026-01-28 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_f1473793509d02e8dcf4877dd76514f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_98c1cd760946c9a682432d3788c44b36.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_95dae2f1ba195d951a45c32aa00dab55.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee30a7d0>
2026-01-28 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Ffd%252F13fd821f1c711883b8ff091b1dce418a%252Fpa%252FKX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg saved to cache
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20195a17-87c8-573e-b804-28bdd704227f
2026-01-28 10:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20195a17-87c8-573e-b804-28bdd704227f, skipping ID generation
2026-01-28 10:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20195a17-87c8-573e-b804-28bdd704227f with scrape type 1
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 20195a17-87c8-573e-b804-28bdd704227f from tracking dictionaries
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20195a17-87c8-573e-b804-28bdd704227f sending to next pipeline
2026-01-28 10:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20195a17-87c8-573e-b804-28bdd704227f, identifier: KX23576
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee308ed0>
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_09427b807b455e072994ec72b6076c91.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_09427b807b455e072994ec72b6076c91.jpg saved to cache
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee309890>
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_6f95786297e88dca9dc39e2174b84be1.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_6f95786297e88dca9dc39e2174b84be1.jpg saved to cache
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 718352cb-0471-5215-b8e7-c5bfe7b76a7a with identifier: FZ17961
2026-01-28 10:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718352cb-0471-5215-b8e7-c5bfe7b76a7a with scrape type 2
2026-01-28 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 718352cb-0471-5215-b8e7-c5bfe7b76a7a with scrape type 2
2026-01-28 10:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 718352cb-0471-5215-b8e7-c5bfe7b76a7a, identifier: FZ17961
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee284590>
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_0032fc7efd7a97dc3186fea96c45660f.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_0032fc7efd7a97dc3186fea96c45660f.jpg saved to cache
2026-01-28 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f50359d0>
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7b09231518d32f8efd2ced222c63efd0.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7b09231518d32f8efd2ced222c63efd0.jpg saved to cache
2026-01-28 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee35a810>
2026-01-28 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg saved to cache
2026-01-28 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee57a850>
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_d4fc962297c706cdd20f35c414d7340b.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_d4fc962297c706cdd20f35c414d7340b.jpg saved to cache
2026-01-28 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20195a17-87c8-573e-b804-28bdd704227f with identifier: KX23576
2026-01-28 10:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20195a17-87c8-573e-b804-28bdd704227f with identifier: KX23576
2026-01-28 10:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20195a17-87c8-573e-b804-28bdd704227f with identifier: KX23576 to the API
2026-01-28 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:50:29Z',
 'fuel_type': 'diesel',
 'id': '20195a17-87c8-573e-b804-28bdd704227f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX23576',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 66174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_0cd74a0bfbd46c93e37ab0921dc33d8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_174ed5bc8ca1109bcc563aa667ac211b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_2ef5820e176b70b503819be8f73c2ba3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7d397d7e5503c93d4c4c666735e60af1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_49d81597ca058530acdccb6500634b64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_34b80ed42dbf6598fedf7ffd7461d43e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c40dabcece5c4fb819f66c621a55ead3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_96ebba9c8255c6343222ba3f67985170.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_e632f74a6a04cee01637d299c8c57956.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_24516de8f3e7bd3ac108da7417587e16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913185,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_7db0439039eab5bfe1d2bb99998094ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_c83be7bc0d60132bbb3e203947ef854f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_45a6670c6d144a94981503cae149d125.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_3c70546f8c3693d43fbb485a00055a7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20195a17-87c8-573e-b804-28bdd704227f/20195a17-87c8-573e-b804-28bdd704227f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/fd/13fd821f1c711883b8ff091b1dce418a/pa/KX23576_4806c23ae21dfb8e02c5104640938f65.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2023}
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX23576%27 HTTP/1.1" 200 None
2026-01-28 10:03:17 [auto1.it] INFO: Saving data for KX23576: {'created_time': 1769594597.427318, 'last_price_update_time': 1769594597.427331, 'auction_closing_time': 1769705429.0}
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KX23576') HTTP/1.1" 204 0
2026-01-28 10:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 718352cb-0471-5215-b8e7-c5bfe7b76a7a with identifier: FZ17961
2026-01-28 10:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 718352cb-0471-5215-b8e7-c5bfe7b76a7a with identifier: FZ17961
2026-01-28 10:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 718352cb-0471-5215-b8e7-c5bfe7b76a7a with identifier: FZ17961 to the API
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FZ17961>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:08:31Z',
 'fuel_type': 'petrol',
 'id': '718352cb-0471-5215-b8e7-c5bfe7b76a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ17961',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 136256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2021}
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ17961%27 HTTP/1.1" 200 None
2026-01-28 10:03:17 [auto1.it] INFO: Saving data for FZ17961: {'auction_closing_time': 1769702911.0, 'created_time': 1769198936.207015, 'last_price_update_time': 1769594597.749607}
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FZ17961') HTTP/1.1" 204 0
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN71462> (referer: https://www.auto1.com/v1/car-details-view/LN71462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC58138> (referer: https://www.auto1.com/v1/car-details-view/KC58138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA63889> (referer: https://www.auto1.com/v1/car-details-view/MA63889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS60698> (referer: https://www.auto1.com/v1/car-details-view/YS60698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA09787> (referer: https://www.auto1.com/v1/car-details-view/PA09787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM11522> (referer: https://www.auto1.com/v1/car-details-view/MM11522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_61568a1439d8cd22225b3f96578b3ec9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_37a5419ead8d8f3e5069341c35b66e12.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef93790>
2026-01-28 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_f1473793509d02e8dcf4877dd76514f2.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_f1473793509d02e8dcf4877dd76514f2.jpg saved to cache
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee23d810>
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_98c1cd760946c9a682432d3788c44b36.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_98c1cd760946c9a682432d3788c44b36.jpg saved to cache
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f5cdf090>
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_95dae2f1ba195d951a45c32aa00dab55.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_95dae2f1ba195d951a45c32aa00dab55.jpg saved to cache
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee530e10>
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg saved to cache
2026-01-28 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f403fe10>
2026-01-28 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg saved to cache
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES44570> (referer: https://www.auto1.com/v1/car-details-view/ES44570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af58132-80ec-5e1b-a7fb-15b31459ca87 with identifier: LN71462
2026-01-28 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af58132-80ec-5e1b-a7fb-15b31459ca87 with scrape type 1
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_3a6ad08277c38260ee36ceb619b05717.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_3a6ad08277c38260ee36ceb619b05717.jpg not downloaded yet
2026-01-28 10:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-01-28 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with scrape type 2
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with scrape type 2
2026-01-28 10:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1, identifier: KC58138
2026-01-28 10:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with identifier: MA63889
2026-01-28 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with scrape type 1
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_9e9616a32d1b6977344851ee8c892bcf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_9e9616a32d1b6977344851ee8c892bcf.jpg not downloaded yet
2026-01-28 10:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2026-01-28 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7c1258-7228-5621-8263-9a7d8023e526 with scrape type 2
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7c1258-7228-5621-8263-9a7d8023e526 with scrape type 2
2026-01-28 10:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c7c1258-7228-5621-8263-9a7d8023e526, identifier: YS60698
2026-01-28 10:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4377846a-fa84-5412-9bef-9ab700f6fab6 with identifier: PA09787
2026-01-28 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4377846a-fa84-5412-9bef-9ab700f6fab6 with scrape type 1
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4377846a-fa84-5412-9bef-9ab700f6fab6
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_833679e062889a0e6ecf00dfee654961.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_833679e062889a0e6ecf00dfee654961.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_251b2ce1e4722c3880b76a0c693cae76.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_251b2ce1e4722c3880b76a0c693cae76.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_59bb38720e2c27bc703eb77f4268d710.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_59bb38720e2c27bc703eb77f4268d710.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_facfe620f1be498645f4a1f526938aa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_facfe620f1be498645f4a1f526938aa8.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_7597f096388292c8a2a2a5e2a4332549.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_7597f096388292c8a2a2a5e2a4332549.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_ce8c5aff5af5f52c1b40fa8b4b16dbbc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_ce8c5aff5af5f52c1b40fa8b4b16dbbc.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_8e2f36fc9ed678f65440253af4fbcb8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8e2f36fc9ed678f65440253af4fbcb8d.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_75fd21548853a2d302ba4162f76dc544.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_75fd21548853a2d302ba4162f76dc544.jpg already downloaded
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_b01e593f309d1c35cfd6b175c9ff1c18.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_b01e593f309d1c35cfd6b175c9ff1c18.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_bb4fd5a2adf75eff3cdcfb2f83a6adc4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_bb4fd5a2adf75eff3cdcfb2f83a6adc4.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_401a77615567cbf95bcd6f8dfffd9c47.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_401a77615567cbf95bcd6f8dfffd9c47.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_8c4660a31c2ab61036b34eb3d2b2569d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8c4660a31c2ab61036b34eb3d2b2569d.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_a6405483636cbf2f79e5684270e778b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_a6405483636cbf2f79e5684270e778b8.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_f623b332c51785c9ff25fa970c68ffe2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_f623b332c51785c9ff25fa970c68ffe2.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F78%252Fa578feb6e4bc8ff712d1d2db1c40be00%252Fpa%252FPA09787_d62c54df5557d3b49e8687b09f9e5a4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_d62c54df5557d3b49e8687b09f9e5a4d.jpg already downloaded
2026-01-28 10:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4377846a-fa84-5412-9bef-9ab700f6fab6, identifier: PA09787
2026-01-28 10:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc30007-38fa-5bdb-a50e-8e045e8cc35f with identifier: MM11522
2026-01-28 10:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc30007-38fa-5bdb-a50e-8e045e8cc35f with scrape type 1
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item bfc30007-38fa-5bdb-a50e-8e045e8cc35f
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_bbc568b20ce9d812800100e21e9af856.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_bbc568b20ce9d812800100e21e9af856.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_2e2c09572acc49efdfb94f3610155480.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2e2c09572acc49efdfb94f3610155480.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_2dc4b20a331c02ffe7d6bb36931a0fb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2dc4b20a331c02ffe7d6bb36931a0fb9.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_b8f63f2b272e82b7ecfa8f6900170feb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_b8f63f2b272e82b7ecfa8f6900170feb.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_2c96cb0dde1530d4f48479034849cf08.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2c96cb0dde1530d4f48479034849cf08.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_5b23cfd98e7cd3456c49ad22a2a0859c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_5b23cfd98e7cd3456c49ad22a2a0859c.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_faf7be0fd363826e909931e196c346d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_faf7be0fd363826e909931e196c346d2.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_9f423db277662b91938eb00b44e1ad00.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_9f423db277662b91938eb00b44e1ad00.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_6b24e7da0e391e57c9e586de78f88bb5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_6b24e7da0e391e57c9e586de78f88bb5.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_4cf5371c0889c5e54d86de8169ee259c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4cf5371c0889c5e54d86de8169ee259c.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_91a15d2a647b145a0ce49fc67e501a58.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_91a15d2a647b145a0ce49fc67e501a58.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_4e1700a27a5380f2380346bf5947720c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4e1700a27a5380f2380346bf5947720c.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_14a5d0dcdb712a94f821d95a09e71b04.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_14a5d0dcdb712a94f821d95a09e71b04.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_46e905d6e4b1bf7033d0721795ab58ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_46e905d6e4b1bf7033d0721795ab58ed.jpg already downloaded
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F71%252Fcd71677af54c5ae35652dc9774a5f862%252Fpa%252FMM11522_4aaf7fef14bc5f93ea22360deaf1a50e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4aaf7fef14bc5f93ea22360deaf1a50e.jpg already downloaded
2026-01-28 10:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfc30007-38fa-5bdb-a50e-8e045e8cc35f, identifier: MM11522
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee515b90>
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_61568a1439d8cd22225b3f96578b3ec9.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_61568a1439d8cd22225b3f96578b3ec9.jpg saved to cache
2026-01-28 10:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5157d0>
2026-01-28 10:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_37a5419ead8d8f3e5069341c35b66e12.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_37a5419ead8d8f3e5069341c35b66e12.jpg saved to cache
2026-01-28 10:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-01-28 10:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-01-28 10:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138 to the API
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC58138>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-01-29T16:36:27Z',
 'fuel_type': 'diesel',
 'id': '46eab6e0-c269-52f3-ab4e-53eceb45ecc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC58138',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 108774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Audi Q7 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-01-28 10:03:21 [auto1.it] INFO: Saving data for KC58138: {'auction_closing_time': 1769704587.0, 'created_time': 1768334755.918024, 'last_price_update_time': 1769594601.751861}
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC58138') HTTP/1.1" 204 0
2026-01-28 10:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2026-01-28 10:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2026-01-28 10:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698 to the API
2026-01-28 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS60698>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:02:55Z',
 'fuel_type': 'petrol',
 'id': '7c7c1258-7228-5621-8263-9a7d8023e526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS60698',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 7680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2024}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [auto1.it] INFO: Saving data for YS60698: {'auction_closing_time': 1769702575.0, 'created_time': 1768298877.921546, 'last_price_update_time': 1769594602.267738}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS60698') HTTP/1.1" 204 0
2026-01-28 10:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4377846a-fa84-5412-9bef-9ab700f6fab6 with identifier: PA09787
2026-01-28 10:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4377846a-fa84-5412-9bef-9ab700f6fab6 with identifier: PA09787
2026-01-28 10:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4377846a-fa84-5412-9bef-9ab700f6fab6 with identifier: PA09787 to the API
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA09787>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:07:03Z',
 'fuel_type': 'diesel',
 'id': '4377846a-fa84-5412-9bef-9ab700f6fab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA09787',
 'listing': 'auction',
 'location': 'IT, Imola',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 128686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_833679e062889a0e6ecf00dfee654961.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_251b2ce1e4722c3880b76a0c693cae76.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_59bb38720e2c27bc703eb77f4268d710.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_facfe620f1be498645f4a1f526938aa8.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_7597f096388292c8a2a2a5e2a4332549.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_ce8c5aff5af5f52c1b40fa8b4b16dbbc.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8e2f36fc9ed678f65440253af4fbcb8d.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_75fd21548853a2d302ba4162f76dc544.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_b01e593f309d1c35cfd6b175c9ff1c18.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_bb4fd5a2adf75eff3cdcfb2f83a6adc4.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_401a77615567cbf95bcd6f8dfffd9c47.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8c4660a31c2ab61036b34eb3d2b2569d.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_a6405483636cbf2f79e5684270e778b8.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_f623b332c51785c9ff25fa970c68ffe2.jpg',
                'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_d62c54df5557d3b49e8687b09f9e5a4d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_833679e062889a0e6ecf00dfee654961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_251b2ce1e4722c3880b76a0c693cae76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_59bb38720e2c27bc703eb77f4268d710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_facfe620f1be498645f4a1f526938aa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_7597f096388292c8a2a2a5e2a4332549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_ce8c5aff5af5f52c1b40fa8b4b16dbbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8e2f36fc9ed678f65440253af4fbcb8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_75fd21548853a2d302ba4162f76dc544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_b01e593f309d1c35cfd6b175c9ff1c18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_bb4fd5a2adf75eff3cdcfb2f83a6adc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_401a77615567cbf95bcd6f8dfffd9c47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_8c4660a31c2ab61036b34eb3d2b2569d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_a6405483636cbf2f79e5684270e778b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_f623b332c51785c9ff25fa970c68ffe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4377846a-fa84-5412-9bef-9ab700f6fab6/4377846a-fa84-5412-9bef-9ab700f6fab6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/78/a578feb6e4bc8ff712d1d2db1c40be00/pa/PA09787_d62c54df5557d3b49e8687b09f9e5a4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Xpossible ISG 2WD',
 'year': 2018}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA09787%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [auto1.it] INFO: Saving data for PA09787: {'auction_closing_time': 1769702823.0, 'created_time': 1769594602.583296, 'last_price_update_time': 1769594602.583313}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA09787') HTTP/1.1" 204 0
2026-01-28 10:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfc30007-38fa-5bdb-a50e-8e045e8cc35f with identifier: MM11522
2026-01-28 10:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfc30007-38fa-5bdb-a50e-8e045e8cc35f with identifier: MM11522
2026-01-28 10:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 10:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bfc30007-38fa-5bdb-a50e-8e045e8cc35f spider: auto1.it
2026-01-28 10:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bfc30007-38fa-5bdb-a50e-8e045e8cc35f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-01-29T16:23:52Z',
 'fuel_type': 'diesel',
 'id': 'bfc30007-38fa-5bdb-a50e-8e045e8cc35f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM11522',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 67867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_bbc568b20ce9d812800100e21e9af856.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2e2c09572acc49efdfb94f3610155480.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2dc4b20a331c02ffe7d6bb36931a0fb9.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_b8f63f2b272e82b7ecfa8f6900170feb.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2c96cb0dde1530d4f48479034849cf08.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_5b23cfd98e7cd3456c49ad22a2a0859c.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_faf7be0fd363826e909931e196c346d2.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_9f423db277662b91938eb00b44e1ad00.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_6b24e7da0e391e57c9e586de78f88bb5.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4cf5371c0889c5e54d86de8169ee259c.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_91a15d2a647b145a0ce49fc67e501a58.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4e1700a27a5380f2380346bf5947720c.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_14a5d0dcdb712a94f821d95a09e71b04.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_46e905d6e4b1bf7033d0721795ab58ed.jpg',
                'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4aaf7fef14bc5f93ea22360deaf1a50e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_bbc568b20ce9d812800100e21e9af856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2e2c09572acc49efdfb94f3610155480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2dc4b20a331c02ffe7d6bb36931a0fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_b8f63f2b272e82b7ecfa8f6900170feb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_2c96cb0dde1530d4f48479034849cf08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_5b23cfd98e7cd3456c49ad22a2a0859c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_faf7be0fd363826e909931e196c346d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_9f423db277662b91938eb00b44e1ad00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_6b24e7da0e391e57c9e586de78f88bb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4cf5371c0889c5e54d86de8169ee259c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_91a15d2a647b145a0ce49fc67e501a58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4e1700a27a5380f2380346bf5947720c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_14a5d0dcdb712a94f821d95a09e71b04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_46e905d6e4b1bf7033d0721795ab58ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfc30007-38fa-5bdb-a50e-8e045e8cc35f/bfc30007-38fa-5bdb-a50e-8e045e8cc35f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/71/cd71677af54c5ae35652dc9774a5f862/pa/MM11522_4aaf7fef14bc5f93ea22360deaf1a50e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Sport',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Sport',
 'year': 2020}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM11522%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [auto1.it] INFO: Saving data for MM11522: {'created_time': 1769594602.855976, 'last_price_update_time': 1769594602.855987, 'auction_closing_time': 1769703832.0}
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MM11522') HTTP/1.1" 204 0
2026-01-28 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_935b5320d203249400b747f8b9cb1eb0.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg not downloaded yet
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_0b7a1b4e8bb6b42a91dc29fb4a7fccc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_0b7a1b4e8bb6b42a91dc29fb4a7fccc5.jpg already downloaded
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_f0840212f7543560bcb3592a36c60210.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_f0840212f7543560bcb3592a36c60210.jpg already downloaded
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_f3c1c7a296609add106a8a72a7668945.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_f3c1c7a296609add106a8a72a7668945.jpg already downloaded
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_51f0647333c70d12c2360f8c7cacc3ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_51f0647333c70d12c2360f8c7cacc3ab.jpg already downloaded
2026-01-28 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_39e39c024fdbaac1f39e14cc3ec129be.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_39e39c024fdbaac1f39e14cc3ec129be.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_79e1fcf0ea7c0fba6196b2f1c0bba2fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_79e1fcf0ea7c0fba6196b2f1c0bba2fb.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_8908b05372c0cc6eecb3f87dce4582f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_8908b05372c0cc6eecb3f87dce4582f8.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_6eb096ab8f3c73587c49bf22884ce3cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_6eb096ab8f3c73587c49bf22884ce3cf.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_e73761b945e99bd2fe0ab99c4822e5f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_e73761b945e99bd2fe0ab99c4822e5f0.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_0bedfd24303b7019236fec34b08c175c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_0bedfd24303b7019236fec34b08c175c.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_3451cc70004ef96b5cc69354168a1698.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_3451cc70004ef96b5cc69354168a1698.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_96c1affbf151b2476244abc76789242b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_96c1affbf151b2476244abc76789242b.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_c14fbfad1ab190d7b9688971f0564713.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_c14fbfad1ab190d7b9688971f0564713.jpg already downloaded
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_6771cb619ed153a867b8838aa29b9770.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_6771cb619ed153a867b8838aa29b9770.jpg already downloaded
2026-01-28 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_b99afe0f82c8e5529e46c1b40690c473.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b99afe0f82c8e5529e46c1b40690c473.jpg not downloaded yet
2026-01-28 10:03:23 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3116147e-81c4-55c0-be23-02d407a71374 with identifier: ES44570
2026-01-28 10:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3116147e-81c4-55c0-be23-02d407a71374 with scrape type 2
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3116147e-81c4-55c0-be23-02d407a71374 with scrape type 2
2026-01-28 10:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3116147e-81c4-55c0-be23-02d407a71374, identifier: ES44570
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefbf750>
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_935b5320d203249400b747f8b9cb1eb0.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_935b5320d203249400b747f8b9cb1eb0.jpg saved to cache
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_b1d2824fa12db81c32ec381fd708e863.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b1d2824fa12db81c32ec381fd708e863.jpg not downloaded yet
2026-01-28 10:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3116147e-81c4-55c0-be23-02d407a71374 with identifier: ES44570
2026-01-28 10:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3116147e-81c4-55c0-be23-02d407a71374 with identifier: ES44570
2026-01-28 10:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3116147e-81c4-55c0-be23-02d407a71374 with identifier: ES44570 to the API
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ES44570>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2026-01-29T16:06:28Z',
 'fuel_type': 'petrol',
 'id': '3116147e-81c4-55c0-be23-02d407a71374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES44570',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mahindra',
 'model': 'KUV 100',
 'odometer': 15553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mahindra KUV 100 1.2 K6+',
 'transmission': 'manual',
 'trim': 'K6+',
 'year': 2022}
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44570%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [auto1.it] INFO: Saving data for ES44570: {'auction_closing_time': 1769702788.0, 'created_time': 1769457985.278939, 'last_price_update_time': 1769594604.066716}
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES44570') HTTP/1.1" 204 0
2026-01-28 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7e4509d056643946038377b502ebe365.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:24 [auto1.it] INFO: Found listing with ID: ME44035
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44035%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [auto1.it] INFO: Scrape type for ME44035: 2
2026-01-28 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_0505a67781aa81b9c3779d83d3487125.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg not downloaded yet
2026-01-28 10:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3e9510>
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg saved to cache
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:24 [auto1.it] INFO: Found listing with ID: NE66733
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE66733%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [auto1.it] INFO: Scrape type for NE66733: 2
2026-01-28 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF48878> (referer: https://www.auto1.com/v1/car-details-view/KF48878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC16771> (referer: https://www.auto1.com/v1/car-details-view/NC16771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg not downloaded yet
2026-01-28 10:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:24 [auto1.it] INFO: Found listing with ID: GC47799
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC47799%27 HTTP/1.1" 200 None
2026-01-28 10:03:24 [auto1.it] INFO: Scrape type for GC47799: 2
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee287510>
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_7e4509d056643946038377b502ebe365.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7e4509d056643946038377b502ebe365.jpg saved to cache
2026-01-28 10:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee13ed0>
2026-01-28 10:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_0505a67781aa81b9c3779d83d3487125.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_0505a67781aa81b9c3779d83d3487125.jpg saved to cache
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9b1a2d36497734c7c89a3fc93e401613.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: DU90270
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU90270%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for DU90270: 2
2026-01-28 10:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_d224dfa9193a0451f36a8546720207d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d224dfa9193a0451f36a8546720207d2.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: AX41377
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX41377%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for AX41377: 1
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg not downloaded yet
2026-01-28 10:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7804af6-9699-5a6b-91ed-88bc86b7b245 with identifier: KF48878
2026-01-28 10:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7804af6-9699-5a6b-91ed-88bc86b7b245 with scrape type 1
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_cb1a318d7826a16063e4b1e35305703f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_cb1a318d7826a16063e4b1e35305703f.jpg not downloaded yet
2026-01-28 10:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with identifier: NC16771
2026-01-28 10:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with scrape type 1
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: XY86470
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY86470%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for XY86470: 2
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_d26deb9bbca6273333cd94fb31dda077.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d26deb9bbca6273333cd94fb31dda077.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_5a77c4a48c21c849694fba37c1ad672f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_5a77c4a48c21c849694fba37c1ad672f.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_e52d752c67d8b894944e8cbb176012a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_e52d752c67d8b894944e8cbb176012a2.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: NM21779
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM21779%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for NM21779: 1
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg not downloaded yet
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee16a50>
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_9b1a2d36497734c7c89a3fc93e401613.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9b1a2d36497734c7c89a3fc93e401613.jpg saved to cache
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: GZ41788
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ41788%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for GZ41788: 2
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_1d7236015f7ad263dce675db7bf41c59.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_1d7236015f7ad263dce675db7bf41c59.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: MV90862
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV90862%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for MV90862: 2
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_16344e92a0d248807bb358dc8dee761c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_16344e92a0d248807bb358dc8dee761c.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_bf74f8355a34a5449f0d657fb4fba117.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bf74f8355a34a5449f0d657fb4fba117.jpg not downloaded yet
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_da2a99ad12002066244758fa03d99a5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_da2a99ad12002066244758fa03d99a5e.jpg not downloaded yet
2026-01-28 10:03:25 [auto1.it] INFO: Found listing with ID: NE87836
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE87836%27 HTTP/1.1" 200 None
2026-01-28 10:03:25 [auto1.it] INFO: Scrape type for NE87836: 2
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg not downloaded yet
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: ZC79626
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC79626%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for ZC79626: 2
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_954b90121b8ea5fc389d02d5194b98f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_954b90121b8ea5fc389d02d5194b98f2.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_5f86195c5c9453f3676e10293b4c956e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5f86195c5c9453f3676e10293b4c956e.jpg not downloaded yet
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: FZ01264
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ01264%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for FZ01264: 1
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg not downloaded yet
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: FC06007
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC06007%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for FC06007: 1
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg not downloaded yet
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: FD10963
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD10963%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for FD10963: 2
2026-01-28 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_4f3bd49bc3248ce8eb208476997dadce.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4f3bd49bc3248ce8eb208476997dadce.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg not downloaded yet
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: ZU18673
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU18673%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for ZU18673: 2
2026-01-28 10:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_880aa9b133f5824395533a7d687c9ea5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_880aa9b133f5824395533a7d687c9ea5.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg not downloaded yet
2026-01-28 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: AE78786
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE78786%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for AE78786: 2
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_d807178ff24868bdc3090169fd742fb2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_d807178ff24868bdc3090169fd742fb2.jpg not downloaded yet
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_79fa2f308e6a1438d451d63eba587ef2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_79fa2f308e6a1438d451d63eba587ef2.jpg not downloaded yet
2026-01-28 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_63348f9fb6e63997859057413b67cdab.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:26 [auto1.it] INFO: Found listing with ID: EE21788
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE21788%27 HTTP/1.1" 200 None
2026-01-28 10:03:26 [auto1.it] INFO: Scrape type for EE21788: 2
2026-01-28 10:03:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22b110>
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg saved to cache
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg not downloaded yet
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_5150efe471568a53124122a1960c853d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5150efe471568a53124122a1960c853d.jpg not downloaded yet
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_4a4056f1a1af05a775648757872ec4c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:27 [auto1.it] INFO: Found listing with ID: LA82153
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA82153%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [auto1.it] INFO: Scrape type for LA82153: 2
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_61571c2ae3b651f403837afdd92ca593.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_bdd826e420fa38771171743a2d1b064c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bdd826e420fa38771171743a2d1b064c.jpg not downloaded yet
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_436ad8cd0158068f0685f257255250de.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_436ad8cd0158068f0685f257255250de.jpg not downloaded yet
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC47799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME44035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:27 [auto1.it] INFO: Found listing with ID: LM91888
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM91888%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [auto1.it] INFO: Scrape type for LM91888: 2
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_7a4d6d4dc91656afc7876361168bc620.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_7a4d6d4dc91656afc7876361168bc620.jpg not downloaded yet
2026-01-28 10:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee206950>
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg saved to cache
2026-01-28 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefcdb10>
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_63348f9fb6e63997859057413b67cdab.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_63348f9fb6e63997859057413b67cdab.jpg saved to cache
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:28 [auto1.it] INFO: Found listing with ID: JN06043
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN06043%27 HTTP/1.1" 200 None
2026-01-28 10:03:28 [auto1.it] INFO: Scrape type for JN06043: 1
2026-01-28 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_3a6ad08277c38260ee36ceb619b05717.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:28 [auto1.it] INFO: Found listing with ID: EE55407
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE55407%27 HTTP/1.1" 200 None
2026-01-28 10:03:28 [auto1.it] INFO: Scrape type for EE55407: 2
2026-01-28 10:03:28 [auto1.it] INFO: Found listing with ID: MP41333
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP41333%27 HTTP/1.1" 200 None
2026-01-28 10:03:28 [auto1.it] INFO: Scrape type for MP41333: 2
2026-01-28 10:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee345b50>
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_4a4056f1a1af05a775648757872ec4c9.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_4a4056f1a1af05a775648757872ec4c9.jpg saved to cache
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee4d6610>
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_61571c2ae3b651f403837afdd92ca593.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_61571c2ae3b651f403837afdd92ca593.jpg saved to cache
2026-01-28 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee344410>
2026-01-28 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg saved to cache
2026-01-28 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:03:29 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b1d2824fa12db81c32ec381fd708e863.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:29 [auto1.it] INFO: Found listing with ID: WK96429
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK96429%27 HTTP/1.1" 200 None
2026-01-28 10:03:29 [auto1.it] INFO: Scrape type for WK96429: 1
2026-01-28 10:03:29 [auto1.it] INFO: Found listing with ID: VF21484
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF21484%27 HTTP/1.1" 200 None
2026-01-28 10:03:29 [auto1.it] INFO: Scrape type for VF21484: 2
2026-01-28 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD10963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:29 [auto1.it] INFO: Found listing with ID: HL10367
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10367%27 HTTP/1.1" 200 None
2026-01-28 10:03:29 [auto1.it] INFO: Scrape type for HL10367: 2
2026-01-28 10:03:29 [auto1.it] INFO: Found listing with ID: MM70569
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70569%27 HTTP/1.1" 200 None
2026-01-28 10:03:29 [auto1.it] INFO: Scrape type for MM70569: 2
2026-01-28 10:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4047e10>
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg saved to cache
2026-01-28 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee16710>
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_3a6ad08277c38260ee36ceb619b05717.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_3a6ad08277c38260ee36ceb619b05717.jpg saved to cache
2026-01-28 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:30 [auto1.it] INFO: Found listing with ID: VB99603
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB99603%27 HTTP/1.1" 200 None
2026-01-28 10:03:30 [auto1.it] INFO: Scrape type for VB99603: 1
2026-01-28 10:03:30 [auto1.it] INFO: Found listing with ID: ZC81530
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC81530%27 HTTP/1.1" 200 None
2026-01-28 10:03:30 [auto1.it] INFO: Scrape type for ZC81530: 2
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee01550>
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_b1d2824fa12db81c32ec381fd708e863.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b1d2824fa12db81c32ec381fd708e863.jpg saved to cache
2026-01-28 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee221f10>
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg saved to cache
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_7a4d6d4dc91656afc7876361168bc620.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: EH66713
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH66713%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for EH66713: 2
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: YU89741
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU89741%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for YU89741: 2
2026-01-28 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_436ad8cd0158068f0685f257255250de.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: EK64869
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK64869%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for EK64869: 2
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: XS07173
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS07173%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for XS07173: 1
2026-01-28 10:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f404ffd0>
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg saved to cache
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_9e9616a32d1b6977344851ee8c892bcf.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: FU09112
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU09112%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for FU09112: 2
2026-01-28 10:03:31 [auto1.it] INFO: Found listing with ID: CE51434
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE51434%27 HTTP/1.1" 200 None
2026-01-28 10:03:31 [auto1.it] INFO: Scrape type for CE51434: 2
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee229410>
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_14.jpg HTTP/1.1" 201 0
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_7a4d6d4dc91656afc7876361168bc620.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_7a4d6d4dc91656afc7876361168bc620.jpg saved to cache
2026-01-28 10:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee401c50>
2026-01-28 10:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_436ad8cd0158068f0685f257255250de.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_436ad8cd0158068f0685f257255250de.jpg saved to cache
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: WM91186
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91186%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for WM91186: 2
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: EJ48263
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ48263%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for EJ48263: 2
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: CL71823
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL71823%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for CL71823: 1
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: CF92520
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF92520%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for CF92520: 2
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM91888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC47799> (referer: https://www.auto1.com/v1/car-details-view/GC47799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN06043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE55407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA82153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME44035> (referer: https://www.auto1.com/v1/car-details-view/ME44035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP41333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: VJ94912
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for VJ94912: 2
2026-01-28 10:03:32 [auto1.it] INFO: Found listing with ID: SC57699
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-01-28 10:03:32 [auto1.it] INFO: Scrape type for SC57699: 2
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22b790>
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fa3%252F0ca31874de5c9fdd07bb4adfb39b2b89%252Fpa%252FMA63889_9e9616a32d1b6977344851ee8c892bcf.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_9e9616a32d1b6977344851ee8c892bcf.jpg saved to cache
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d
2026-01-28 10:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d, skipping ID generation
2026-01-28 10:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with scrape type 1
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d from tracking dictionaries
2026-01-28 10:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9789f61c-3f7d-5a45-8b7b-b1a130d0274d sending to next pipeline
2026-01-28 10:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d, identifier: MA63889
2026-01-28 10:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with identifier: MA63889
2026-01-28 10:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with identifier: MA63889
2026-01-28 10:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9789f61c-3f7d-5a45-8b7b-b1a130d0274d with identifier: MA63889 to the API
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_9e9616a32d1b6977344851ee8c892bcf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:04:43Z',
 'fuel_type': 'petrol',
 'id': '9789f61c-3f7d-5a45-8b7b-b1a130d0274d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA63889',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 34761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2975159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_9e9616a32d1b6977344851ee8c892bcf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_0b7a1b4e8bb6b42a91dc29fb4a7fccc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_f0840212f7543560bcb3592a36c60210.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3030329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_f3c1c7a296609add106a8a72a7668945.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_51f0647333c70d12c2360f8c7cacc3ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_39e39c024fdbaac1f39e14cc3ec129be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_79e1fcf0ea7c0fba6196b2f1c0bba2fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_8908b05372c0cc6eecb3f87dce4582f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3074671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_6eb096ab8f3c73587c49bf22884ce3cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_e73761b945e99bd2fe0ab99c4822e5f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_0bedfd24303b7019236fec34b08c175c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_3451cc70004ef96b5cc69354168a1698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_96c1affbf151b2476244abc76789242b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_c14fbfad1ab190d7b9688971f0564713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9789f61c-3f7d-5a45-8b7b-b1a130d0274d/9789f61c-3f7d-5a45-8b7b-b1a130d0274d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/a3/0ca31874de5c9fdd07bb4adfb39b2b89/pa/MA63889_6771cb619ed153a867b8838aa29b9770.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2022}
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA63889%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Saving data for MA63889: {'auction_closing_time': 1769702683.0, 'created_time': 1769594613.376102, 'last_price_update_time': 1769594613.376113}
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA63889') HTTP/1.1" 204 0
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: CK57785
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK57785%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for CK57785: 2
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: JR02947
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02947%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for JR02947: 2
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: XX41967
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX41967%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for XX41967: 1
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: XV95315
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV95315%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for XV95315: 2
2026-01-28 10:03:33 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ce8894-2656-5377-8f51-1fc2df2f6983 with identifier: GC47799
2026-01-28 10:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ce8894-2656-5377-8f51-1fc2df2f6983 with scrape type 2
2026-01-28 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ce8894-2656-5377-8f51-1fc2df2f6983 with scrape type 2
2026-01-28 10:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39ce8894-2656-5377-8f51-1fc2df2f6983, identifier: GC47799
2026-01-28 10:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0f230e-b33a-52a6-958c-db62d617c1f0 with identifier: ME44035
2026-01-28 10:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f230e-b33a-52a6-958c-db62d617c1f0 with scrape type 2
2026-01-28 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b0f230e-b33a-52a6-958c-db62d617c1f0 with scrape type 2
2026-01-28 10:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b0f230e-b33a-52a6-958c-db62d617c1f0, identifier: ME44035
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: KW25674
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW25674%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for KW25674: 2
2026-01-28 10:03:33 [auto1.it] INFO: Found listing with ID: FJ50946
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ50946%27 HTTP/1.1" 200 None
2026-01-28 10:03:33 [auto1.it] INFO: Scrape type for FJ50946: 2
2026-01-28 10:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39ce8894-2656-5377-8f51-1fc2df2f6983 with identifier: GC47799
2026-01-28 10:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39ce8894-2656-5377-8f51-1fc2df2f6983 with identifier: GC47799
2026-01-28 10:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39ce8894-2656-5377-8f51-1fc2df2f6983 with identifier: GC47799 to the API
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC47799>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:38:14Z',
 'fuel_type': 'hybrid',
 'id': '39ce8894-2656-5377-8f51-1fc2df2f6983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC47799',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 27773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2022}
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC47799%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Saving data for GC47799: {'auction_closing_time': 1769704694.0, 'created_time': 1767989279.69673, 'last_price_update_time': 1769594614.313458}
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC47799') HTTP/1.1" 204 0
2026-01-28 10:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b0f230e-b33a-52a6-958c-db62d617c1f0 with identifier: ME44035
2026-01-28 10:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b0f230e-b33a-52a6-958c-db62d617c1f0 with identifier: ME44035
2026-01-28 10:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b0f230e-b33a-52a6-958c-db62d617c1f0 with identifier: ME44035 to the API
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME44035>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:23:44Z',
 'fuel_type': 'petrol',
 'id': '1b0f230e-b33a-52a6-958c-db62d617c1f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME44035',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 69093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44035%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Saving data for ME44035: {'auction_closing_time': 1769703824.0, 'created_time': 1768384990.431408, 'last_price_update_time': 1769594614.709763}
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME44035') HTTP/1.1" 204 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: WR69312
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for WR69312: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: LC12522
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for LC12522: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: DJ97439
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for DJ97439: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: KD59831
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for KD59831: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: YL06979
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for YL06979: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: AD85366
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for AD85366: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: WD98953
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for WD98953: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: WA67831
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for WA67831: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: ES54295
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for ES54295: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: XK25205
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for XK25205: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: RV64842
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for RV64842: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: RK87672
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2026-01-28 10:03:34 [auto1.it] INFO: Scrape type for RK87672: 0
2026-01-28 10:03:34 [auto1.it] INFO: Found listing with ID: JE97171
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for JE97171: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: JE58021
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58021%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for JE58021: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: KT64780
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for KT64780: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: SM84715
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM84715%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for SM84715: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: AY82882
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for AY82882: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: RF36302
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF36302%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for RF36302: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: KM31760
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM31760%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for KM31760: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: KL52080
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for KL52080: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: RZ08644
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ08644%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for RZ08644: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: ZZ34330
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ34330%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for ZZ34330: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: EN28009
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN28009%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for EN28009: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: LE91264
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE91264%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for LE91264: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: RG08513
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG08513%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for RG08513: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: GK57569
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK57569%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for GK57569: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: NK45302
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for NK45302: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: YE57930
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE57930%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for YE57930: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: ZN33233
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN33233%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for ZN33233: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: SG78459
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for SG78459: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: XY55879
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY55879%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for XY55879: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: CW42905
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW42905%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for CW42905: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: CZ29662
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ29662%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for CZ29662: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: WM90697
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for WM90697: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: FT66355
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for FT66355: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: GL75859
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL75859%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for GL75859: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: LD57265
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for LD57265: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: PM18246
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for PM18246: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for AZ28034: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: JS87755
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for JS87755: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: VB17978
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB17978%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for VB17978: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: UK81379
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for UK81379: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for WN11922: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: UA54373
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for UA54373: 0
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: ST62683
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST62683%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for ST62683: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: TP50671
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP50671%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for TP50671: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: TP44481
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP44481%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for TP44481: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: UL67147
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL67147%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for UL67147: 2
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL10367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB99603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC81530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: AK82218
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK82218%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for AK82218: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: JG96200
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG96200%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for JG96200: 2
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS07173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL71823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: PR00110
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR00110%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for PR00110: 2
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: DK02214
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK02214%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for DK02214: 2
2026-01-28 10:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: LN32386
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN32386%27 HTTP/1.1" 200 None
2026-01-28 10:03:35 [auto1.it] INFO: Scrape type for LN32386: 1
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM70569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF92520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU89741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:35 [auto1.it] INFO: Found listing with ID: CT54414
2026-01-28 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for CT54414: 1
2026-01-28 10:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d6c50>
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg saved to cache
2026-01-28 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: NR00583
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR00583%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for NR00583: 1
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: SU22727
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU22727%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for SU22727: 2
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: UB59491
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB59491%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for UB59491: 2
2026-01-28 10:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bdd826e420fa38771171743a2d1b064c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: CM48697
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM48697%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for CM48697: 2
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: XB13849
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB13849%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for XB13849: 2
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: WP98796
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP98796%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for WP98796: 1
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: EW38389
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38389%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for EW38389: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: ZE02649
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02649%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for ZE02649: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: NA87958
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA87958%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for NA87958: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: VK09157
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK09157%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for VK09157: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: SY78749
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY78749%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for SY78749: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: FL32335
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL32335%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for FL32335: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: KE50808
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50808%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for KE50808: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: UZ89898
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ89898%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for UZ89898: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: CA75041
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA75041%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for CA75041: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: TZ24707
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for TZ24707: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: HW40098
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW40098%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for HW40098: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: EJ94115
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ94115%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for EJ94115: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: EH94386
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH94386%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for EH94386: 0
2026-01-28 10:03:36 [auto1.it] INFO: Found listing with ID: KW61095
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-28 10:03:36 [auto1.it] INFO: Scrape type for KW61095: 0
2026-01-28 10:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee518f50>
2026-01-28 10:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_13.jpg HTTP/1.1" 201 0
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_bdd826e420fa38771171743a2d1b064c.jpg') HTTP/1.1" 204 0
2026-01-28 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bdd826e420fa38771171743a2d1b064c.jpg saved to cache
2026-01-28 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL67147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK64869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM91186/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU09112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE51434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP44481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH66713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ48263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP50671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK82218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST62683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG96200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB99603> (referer: https://www.auto1.com/v1/car-details-view/VB99603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768729e8-49f0-5631-be4a-5683e0697858 with identifier: VB99603
2026-01-28 10:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768729e8-49f0-5631-be4a-5683e0697858 with scrape type 1
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 768729e8-49f0-5631-be4a-5683e0697858
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_ca47fac117b02ceecce72e2c5421f930.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_ca47fac117b02ceecce72e2c5421f930.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_d92f54c7b93ac75d104e3562a02f1376.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_d92f54c7b93ac75d104e3562a02f1376.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_a22b18fd56c56dca505f9b18c258c0ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_a22b18fd56c56dca505f9b18c258c0ab.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_0c975651b760173931fc354f8191a073.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_0c975651b760173931fc354f8191a073.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_669505c59cc37acd4a03710c167594a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_669505c59cc37acd4a03710c167594a1.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_e81159b560f2262444d0ddb025a226da.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e81159b560f2262444d0ddb025a226da.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_f6e08b587a50e8b64d6f2250bd69c419.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e08b587a50e8b64d6f2250bd69c419.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_f3bb18eb751d2ffe1c8bc8544de08bc1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f3bb18eb751d2ffe1c8bc8544de08bc1.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_f6e38a0119fa8f42e5ed09968efe6755.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e38a0119fa8f42e5ed09968efe6755.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_6c251ac1ccdda2fafd285641d830cfd2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_6c251ac1ccdda2fafd285641d830cfd2.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_5279ade2467114a00696ac2916c6dd29.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5279ade2467114a00696ac2916c6dd29.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_29bdb33d539094d3d040ec69f9b2556a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_29bdb33d539094d3d040ec69f9b2556a.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_e4f46535eaa00b381a3ea85928bbd071.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e4f46535eaa00b381a3ea85928bbd071.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_fc422ba1caf599c969b52db3fb9f053a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_fc422ba1caf599c969b52db3fb9f053a.jpg already downloaded
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F85%252Fbe851e65202f5056ac6ea9f689818c17%252Fpa%252FVB99603_5508323a133d409303f2280ff3585755.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5508323a133d409303f2280ff3585755.jpg already downloaded
2026-01-28 10:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 768729e8-49f0-5631-be4a-5683e0697858, identifier: VB99603
2026-01-28 10:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 768729e8-49f0-5631-be4a-5683e0697858 with identifier: VB99603
2026-01-28 10:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 768729e8-49f0-5631-be4a-5683e0697858 with identifier: VB99603
2026-01-28 10:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 768729e8-49f0-5631-be4a-5683e0697858 with identifier: VB99603 to the API
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VB99603>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:18Z',
 'fuel_type': 'diesel',
 'id': '768729e8-49f0-5631-be4a-5683e0697858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB99603',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 52513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_ca47fac117b02ceecce72e2c5421f930.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_d92f54c7b93ac75d104e3562a02f1376.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_a22b18fd56c56dca505f9b18c258c0ab.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_0c975651b760173931fc354f8191a073.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_669505c59cc37acd4a03710c167594a1.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e81159b560f2262444d0ddb025a226da.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e08b587a50e8b64d6f2250bd69c419.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f3bb18eb751d2ffe1c8bc8544de08bc1.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e38a0119fa8f42e5ed09968efe6755.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_6c251ac1ccdda2fafd285641d830cfd2.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5279ade2467114a00696ac2916c6dd29.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_29bdb33d539094d3d040ec69f9b2556a.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e4f46535eaa00b381a3ea85928bbd071.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_fc422ba1caf599c969b52db3fb9f053a.jpg',
                'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5508323a133d409303f2280ff3585755.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_ca47fac117b02ceecce72e2c5421f930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_d92f54c7b93ac75d104e3562a02f1376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_a22b18fd56c56dca505f9b18c258c0ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_0c975651b760173931fc354f8191a073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_669505c59cc37acd4a03710c167594a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e81159b560f2262444d0ddb025a226da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e08b587a50e8b64d6f2250bd69c419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f3bb18eb751d2ffe1c8bc8544de08bc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_f6e38a0119fa8f42e5ed09968efe6755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_6c251ac1ccdda2fafd285641d830cfd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5279ade2467114a00696ac2916c6dd29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_29bdb33d539094d3d040ec69f9b2556a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_e4f46535eaa00b381a3ea85928bbd071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_fc422ba1caf599c969b52db3fb9f053a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_768729e8-49f0-5631-be4a-5683e0697858/768729e8-49f0-5631-be4a-5683e0697858_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/85/be851e65202f5056ac6ea9f689818c17/pa/VB99603_5508323a133d409303f2280ff3585755.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB99603%27 HTTP/1.1" 200 None
2026-01-28 10:03:39 [auto1.it] INFO: Saving data for VB99603: {'created_time': 1769594619.703997, 'last_price_update_time': 1769594619.704009, 'auction_closing_time': 1769704218.0}
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB99603') HTTP/1.1" 204 0
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU89741> (referer: https://www.auto1.com/v1/car-details-view/YU89741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM48697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK64869> (referer: https://www.auto1.com/v1/car-details-view/EK64869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL10367> (referer: https://www.auto1.com/v1/car-details-view/HL10367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC81530> (referer: https://www.auto1.com/v1/car-details-view/ZC81530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB13849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP98796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5270a972-0e8e-5901-aec0-1fc7bac63cfc with identifier: YU89741
2026-01-28 10:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5270a972-0e8e-5901-aec0-1fc7bac63cfc with scrape type 2
2026-01-28 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5270a972-0e8e-5901-aec0-1fc7bac63cfc with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5270a972-0e8e-5901-aec0-1fc7bac63cfc, identifier: YU89741
2026-01-28 10:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5270a972-0e8e-5901-aec0-1fc7bac63cfc with identifier: YU89741
2026-01-28 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5270a972-0e8e-5901-aec0-1fc7bac63cfc with identifier: YU89741
2026-01-28 10:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5270a972-0e8e-5901-aec0-1fc7bac63cfc with identifier: YU89741 to the API
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU89741>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:06:49Z',
 'fuel_type': 'petrol',
 'id': '5270a972-0e8e-5901-aec0-1fc7bac63cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU89741',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 33731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 VGT Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2022}
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU89741%27 HTTP/1.1" 200 None
2026-01-28 10:03:40 [auto1.it] INFO: Saving data for YU89741: {'auction_closing_time': 1769702809.0, 'created_time': 1769198522.06494, 'last_price_update_time': 1769594620.378817}
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU89741') HTTP/1.1" 204 0
2026-01-28 10:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab207949-9b56-51e5-9821-9ee2bc51717d with identifier: EK64869
2026-01-28 10:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab207949-9b56-51e5-9821-9ee2bc51717d with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab207949-9b56-51e5-9821-9ee2bc51717d with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab207949-9b56-51e5-9821-9ee2bc51717d, identifier: EK64869
2026-01-28 10:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41efd39e-b84b-5531-9244-6f767d8dd084 with identifier: HL10367
2026-01-28 10:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41efd39e-b84b-5531-9244-6f767d8dd084 with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41efd39e-b84b-5531-9244-6f767d8dd084 with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41efd39e-b84b-5531-9244-6f767d8dd084, identifier: HL10367
2026-01-28 10:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef109897-af1c-540e-93bf-894c21b0700d with identifier: ZC81530
2026-01-28 10:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef109897-af1c-540e-93bf-894c21b0700d with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef109897-af1c-540e-93bf-894c21b0700d with scrape type 2
2026-01-28 10:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef109897-af1c-540e-93bf-894c21b0700d, identifier: ZC81530
2026-01-28 10:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab207949-9b56-51e5-9821-9ee2bc51717d with identifier: EK64869
2026-01-28 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab207949-9b56-51e5-9821-9ee2bc51717d with identifier: EK64869
2026-01-28 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ab207949-9b56-51e5-9821-9ee2bc51717d spider: auto1.it
2026-01-28 10:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ab207949-9b56-51e5-9821-9ee2bc51717d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:41:40Z',
 'fuel_type': 'diesel',
 'id': 'ab207949-9b56-51e5-9821-9ee2bc51717d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK64869',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 47917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'automatic',
 'trim': 'Premium L1',
 'year': 2019}
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK64869%27 HTTP/1.1" 200 None
2026-01-28 10:03:40 [auto1.it] INFO: Saving data for EK64869: {'auction_closing_time': 1769704900.0, 'created_time': 1767902446.847558, 'last_price_update_time': 1769594620.956297}
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK64869') HTTP/1.1" 204 0
2026-01-28 10:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41efd39e-b84b-5531-9244-6f767d8dd084 with identifier: HL10367
2026-01-28 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41efd39e-b84b-5531-9244-6f767d8dd084 with identifier: HL10367
2026-01-28 10:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41efd39e-b84b-5531-9244-6f767d8dd084 with identifier: HL10367 to the API
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL10367>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:00:50Z',
 'fuel_type': 'diesel',
 'id': '41efd39e-b84b-5531-9244-6f767d8dd084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL10367',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 63167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10367%27 HTTP/1.1" 200 None
2026-01-28 10:03:41 [auto1.it] INFO: Saving data for HL10367: {'auction_closing_time': 1769702450.0, 'created_time': 1768334448.585309, 'last_price_update_time': 1769594621.374359}
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL10367') HTTP/1.1" 204 0
2026-01-28 10:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef109897-af1c-540e-93bf-894c21b0700d with identifier: ZC81530
2026-01-28 10:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef109897-af1c-540e-93bf-894c21b0700d with identifier: ZC81530
2026-01-28 10:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef109897-af1c-540e-93bf-894c21b0700d with identifier: ZC81530 to the API
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC81530>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:01:29Z',
 'fuel_type': 'diesel',
 'id': 'ef109897-af1c-540e-93bf-894c21b0700d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC81530',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 35249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-25',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC81530%27 HTTP/1.1" 200 None
2026-01-28 10:03:41 [auto1.it] INFO: Saving data for ZC81530: {'auction_closing_time': 1769702489.0, 'created_time': 1768334733.534253, 'last_price_update_time': 1769594621.735727}
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC81530') HTTP/1.1" 204 0
2026-01-28 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM91186> (referer: https://www.auto1.com/v1/car-details-view/WM91186/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with identifier: WM91186
2026-01-28 10:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with scrape type 2
2026-01-28 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with scrape type 2
2026-01-28 10:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18badd85-cd7f-5fd7-9adf-0fec026d1a6b, identifier: WM91186
2026-01-28 10:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with identifier: WM91186
2026-01-28 10:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with identifier: WM91186
2026-01-28 10:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18badd85-cd7f-5fd7-9adf-0fec026d1a6b with identifier: WM91186 to the API
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM91186>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 92,
 'expiration_date': '2026-01-29T16:51:45Z',
 'fuel_type': 'petrol',
 'id': '18badd85-cd7f-5fd7-9adf-0fec026d1a6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91186',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 70605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T N-Sport',
 'transmission': 'manual',
 'trim': 'N-Sport',
 'year': 2021}
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91186%27 HTTP/1.1" 200 None
2026-01-28 10:03:42 [auto1.it] INFO: Saving data for WM91186: {'auction_closing_time': 1769705505.0, 'created_time': 1769155256.524598, 'last_price_update_time': 1769594622.308284}
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM91186') HTTP/1.1" 204 0
2026-01-28 10:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU09112> (referer: https://www.auto1.com/v1/car-details-view/FU09112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63cbdcaa-a578-5d36-9711-24eb89e34bab with identifier: FU09112
2026-01-28 10:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63cbdcaa-a578-5d36-9711-24eb89e34bab with scrape type 2
2026-01-28 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63cbdcaa-a578-5d36-9711-24eb89e34bab with scrape type 2
2026-01-28 10:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63cbdcaa-a578-5d36-9711-24eb89e34bab, identifier: FU09112
2026-01-28 10:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63cbdcaa-a578-5d36-9711-24eb89e34bab with identifier: FU09112
2026-01-28 10:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63cbdcaa-a578-5d36-9711-24eb89e34bab with identifier: FU09112
2026-01-28 10:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63cbdcaa-a578-5d36-9711-24eb89e34bab with identifier: FU09112 to the API
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FU09112>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:07:00Z',
 'fuel_type': 'petrol',
 'id': '63cbdcaa-a578-5d36-9711-24eb89e34bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU09112',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 7718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-01-28 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU09112%27 HTTP/1.1" 200 None
2026-01-28 10:03:43 [auto1.it] INFO: Saving data for FU09112: {'auction_closing_time': 1769702820.0, 'created_time': 1767297736.344387, 'last_price_update_time': 1769594623.014033}
2026-01-28 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU09112') HTTP/1.1" 204 0
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK82218> (referer: https://www.auto1.com/v1/car-details-view/AK82218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ48263> (referer: https://www.auto1.com/v1/car-details-view/EJ48263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL67147> (referer: https://www.auto1.com/v1/car-details-view/UL67147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP50671> (referer: https://www.auto1.com/v1/car-details-view/TP50671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF92520> (referer: https://www.auto1.com/v1/car-details-view/CF92520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH66713> (referer: https://www.auto1.com/v1/car-details-view/EH66713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG96200> (referer: https://www.auto1.com/v1/car-details-view/JG96200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with identifier: AK82218
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb52249f-fd46-5492-bf9f-3a1b5391d5e7, identifier: AK82218
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c89e6870-a44d-5ad9-af79-23b5b8a2741b with identifier: EJ48263
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89e6870-a44d-5ad9-af79-23b5b8a2741b with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c89e6870-a44d-5ad9-af79-23b5b8a2741b with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c89e6870-a44d-5ad9-af79-23b5b8a2741b, identifier: EJ48263
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8454178e-f056-55e1-b31d-863c40648b59 with identifier: UL67147
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8454178e-f056-55e1-b31d-863c40648b59 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8454178e-f056-55e1-b31d-863c40648b59 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8454178e-f056-55e1-b31d-863c40648b59, identifier: UL67147
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f47d76-105d-5a60-9691-9bbd335aacc2 with identifier: TP50671
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f47d76-105d-5a60-9691-9bbd335aacc2 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f47d76-105d-5a60-9691-9bbd335aacc2 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7f47d76-105d-5a60-9691-9bbd335aacc2, identifier: TP50671
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f55f26-1988-515b-9c5c-182dc4206338 with identifier: CF92520
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f55f26-1988-515b-9c5c-182dc4206338 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61f55f26-1988-515b-9c5c-182dc4206338 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61f55f26-1988-515b-9c5c-182dc4206338, identifier: CF92520
2026-01-28 10:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e2491a-d384-5233-adc9-a014639904b7 with identifier: EH66713
2026-01-28 10:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e2491a-d384-5233-adc9-a014639904b7 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e2491a-d384-5233-adc9-a014639904b7 with scrape type 2
2026-01-28 10:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8e2491a-d384-5233-adc9-a014639904b7, identifier: EH66713
2026-01-28 10:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with identifier: AK82218
2026-01-28 10:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with identifier: AK82218
2026-01-28 10:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb52249f-fd46-5492-bf9f-3a1b5391d5e7 with identifier: AK82218 to the API
2026-01-28 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK82218>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:49:50Z',
 'fuel_type': 'hybrid',
 'id': 'fb52249f-fd46-5492-bf9f-3a1b5391d5e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK82218',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 106978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2018}
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK82218%27 HTTP/1.1" 200 None
2026-01-28 10:03:44 [auto1.it] INFO: Saving data for AK82218: {'auction_closing_time': 1769705390.0, 'created_time': 1767989114.539419, 'last_price_update_time': 1769594624.350045}
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK82218') HTTP/1.1" 204 0
2026-01-28 10:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c89e6870-a44d-5ad9-af79-23b5b8a2741b with identifier: EJ48263
2026-01-28 10:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c89e6870-a44d-5ad9-af79-23b5b8a2741b with identifier: EJ48263
2026-01-28 10:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c89e6870-a44d-5ad9-af79-23b5b8a2741b with identifier: EJ48263 to the API
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EJ48263>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:58:43Z',
 'fuel_type': 'petrol',
 'id': 'c89e6870-a44d-5ad9-af79-23b5b8a2741b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ48263',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 70624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2023}
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ48263%27 HTTP/1.1" 200 None
2026-01-28 10:03:44 [auto1.it] INFO: Saving data for EJ48263: {'auction_closing_time': 1769705923.0, 'created_time': 1768421250.692008, 'last_price_update_time': 1769594624.695895}
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EJ48263') HTTP/1.1" 204 0
2026-01-28 10:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8454178e-f056-55e1-b31d-863c40648b59 with identifier: UL67147
2026-01-28 10:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8454178e-f056-55e1-b31d-863c40648b59 with identifier: UL67147
2026-01-28 10:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8454178e-f056-55e1-b31d-863c40648b59 with identifier: UL67147 to the API
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL67147>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-01-29T16:24:04Z',
 'fuel_type': 'diesel',
 'id': '8454178e-f056-55e1-b31d-863c40648b59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL67147',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 103600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL67147%27 HTTP/1.1" 200 None
2026-01-28 10:03:45 [auto1.it] INFO: Saving data for UL67147: {'auction_closing_time': 1769703844.0, 'created_time': 1768334556.948967, 'last_price_update_time': 1769594625.067351}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL67147') HTTP/1.1" 204 0
2026-01-28 10:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7f47d76-105d-5a60-9691-9bbd335aacc2 with identifier: TP50671
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-01-28 10:03:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7f47d76-105d-5a60-9691-9bbd335aacc2 with identifier: TP50671
2026-01-28 10:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7f47d76-105d-5a60-9691-9bbd335aacc2 with identifier: TP50671 to the API
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP50671>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:51:47Z',
 'fuel_type': 'diesel',
 'id': 'f7f47d76-105d-5a60-9691-9bbd335aacc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP50671',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 40669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP50671%27 HTTP/1.1" 200 None
2026-01-28 10:03:45 [auto1.it] INFO: Saving data for TP50671: {'auction_closing_time': 1769705507.0, 'created_time': 1768852978.189231, 'last_price_update_time': 1769594625.565831}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP50671') HTTP/1.1" 204 0
2026-01-28 10:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61f55f26-1988-515b-9c5c-182dc4206338 with identifier: CF92520
2026-01-28 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61f55f26-1988-515b-9c5c-182dc4206338 with identifier: CF92520
2026-01-28 10:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61f55f26-1988-515b-9c5c-182dc4206338 with identifier: CF92520 to the API
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF92520>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:10:37Z',
 'fuel_type': 'petrol',
 'id': '61f55f26-1988-515b-9c5c-182dc4206338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF92520',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 109596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF92520%27 HTTP/1.1" 200 None
2026-01-28 10:03:45 [auto1.it] INFO: Saving data for CF92520: {'auction_closing_time': 1769703037.0, 'created_time': 1768334764.289656, 'last_price_update_time': 1769594625.916494}
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CF92520') HTTP/1.1" 204 0
2026-01-28 10:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8e2491a-d384-5233-adc9-a014639904b7 with identifier: EH66713
2026-01-28 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8e2491a-d384-5233-adc9-a014639904b7 with identifier: EH66713
2026-01-28 10:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8e2491a-d384-5233-adc9-a014639904b7 with identifier: EH66713 to the API
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH66713>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:37:36Z',
 'fuel_type': 'petrol',
 'id': 'e8e2491a-d384-5233-adc9-a014639904b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH66713',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 29969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH66713%27 HTTP/1.1" 200 None
2026-01-28 10:03:46 [auto1.it] INFO: Saving data for EH66713: {'auction_closing_time': 1769704656.0, 'created_time': 1768298775.055757, 'last_price_update_time': 1769594626.274571}
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH66713') HTTP/1.1" 204 0
2026-01-28 10:03:46 [scrapy.extensions.logstats] INFO: Crawled 203 pages (at 97 pages/min), scraped 63 items (at 38 items/min)
2026-01-28 10:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34bba451-8860-5da1-b66e-3ad9ec531d87 with identifier: JG96200
2026-01-28 10:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34bba451-8860-5da1-b66e-3ad9ec531d87 with scrape type 2
2026-01-28 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34bba451-8860-5da1-b66e-3ad9ec531d87 with scrape type 2
2026-01-28 10:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34bba451-8860-5da1-b66e-3ad9ec531d87, identifier: JG96200
2026-01-28 10:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34bba451-8860-5da1-b66e-3ad9ec531d87 with identifier: JG96200
2026-01-28 10:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34bba451-8860-5da1-b66e-3ad9ec531d87 with identifier: JG96200
2026-01-28 10:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34bba451-8860-5da1-b66e-3ad9ec531d87 with identifier: JG96200 to the API
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG96200>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:16:57Z',
 'fuel_type': 'diesel',
 'id': '34bba451-8860-5da1-b66e-3ad9ec531d87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG96200',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 51047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG96200%27 HTTP/1.1" 200 None
2026-01-28 10:03:46 [auto1.it] INFO: Saving data for JG96200: {'auction_closing_time': 1769703417.0, 'created_time': 1768384955.283557, 'last_price_update_time': 1769594626.742132}
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JG96200') HTTP/1.1" 204 0
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST62683> (referer: https://www.auto1.com/v1/car-details-view/ST62683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142a4332-8b11-5ca5-b4b0-4c25883fad28 with identifier: ST62683
2026-01-28 10:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142a4332-8b11-5ca5-b4b0-4c25883fad28 with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142a4332-8b11-5ca5-b4b0-4c25883fad28 with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 142a4332-8b11-5ca5-b4b0-4c25883fad28, identifier: ST62683
2026-01-28 10:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 142a4332-8b11-5ca5-b4b0-4c25883fad28 with identifier: ST62683
2026-01-28 10:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 142a4332-8b11-5ca5-b4b0-4c25883fad28 with identifier: ST62683
2026-01-28 10:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 142a4332-8b11-5ca5-b4b0-4c25883fad28 with identifier: ST62683 to the API
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ST62683>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:02:37Z',
 'fuel_type': 'diesel',
 'id': '142a4332-8b11-5ca5-b4b0-4c25883fad28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST62683',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 35642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST62683%27 HTTP/1.1" 200 None
2026-01-28 10:03:47 [auto1.it] INFO: Saving data for ST62683: {'auction_closing_time': 1769702557.0, 'created_time': 1768377707.443649, 'last_price_update_time': 1769594627.550277}
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST62683') HTTP/1.1" 204 0
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR00583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB59491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU22727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM70569> (referer: https://www.auto1.com/v1/car-details-view/MM70569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP44481> (referer: https://www.auto1.com/v1/car-details-view/TP44481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE51434> (referer: https://www.auto1.com/v1/car-details-view/CE51434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP98796> (referer: https://www.auto1.com/v1/car-details-view/WP98796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a818b22d-9f55-5706-a048-f7250454f380 with identifier: MM70569
2026-01-28 10:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a818b22d-9f55-5706-a048-f7250454f380 with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a818b22d-9f55-5706-a048-f7250454f380 with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a818b22d-9f55-5706-a048-f7250454f380, identifier: MM70569
2026-01-28 10:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa83c2b0-9fcb-5723-9053-fc47b9214e7f with identifier: TP44481
2026-01-28 10:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa83c2b0-9fcb-5723-9053-fc47b9214e7f with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa83c2b0-9fcb-5723-9053-fc47b9214e7f with scrape type 2
2026-01-28 10:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa83c2b0-9fcb-5723-9053-fc47b9214e7f, identifier: TP44481
2026-01-28 10:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a818b22d-9f55-5706-a048-f7250454f380 with identifier: MM70569
2026-01-28 10:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a818b22d-9f55-5706-a048-f7250454f380 with identifier: MM70569
2026-01-28 10:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a818b22d-9f55-5706-a048-f7250454f380 with identifier: MM70569 to the API
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MM70569>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:55:47Z',
 'fuel_type': 'gas',
 'id': 'a818b22d-9f55-5706-a048-f7250454f380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM70569',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 25534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70569%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [auto1.it] INFO: Saving data for MM70569: {'auction_closing_time': 1769705747.0, 'created_time': 1768853089.677026, 'last_price_update_time': 1769594628.275109}
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MM70569') HTTP/1.1" 204 0
2026-01-28 10:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa83c2b0-9fcb-5723-9053-fc47b9214e7f with identifier: TP44481
2026-01-28 10:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa83c2b0-9fcb-5723-9053-fc47b9214e7f with identifier: TP44481
2026-01-28 10:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
2026-01-28 10:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fa83c2b0-9fcb-5723-9053-fc47b9214e7f spider: auto1.it
2026-01-28 10:03:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fa83c2b0-9fcb-5723-9053-fc47b9214e7f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'hilux' containing 'hilux'
{'auction_title': '',
 'c_o_2_emission_value': 241,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:04:27Z',
 'fuel_type': 'diesel',
 'id': 'fa83c2b0-9fcb-5723-9053-fc47b9214e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP44481',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 21170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Double Cab Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Double Cab Comfort 4x4',
 'year': 2024}
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP44481%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [auto1.it] INFO: Saving data for TP44481: {'auction_closing_time': 1769702667.0, 'created_time': 1768298771.948913, 'last_price_update_time': 1769594628.506981}
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP44481') HTTP/1.1" 204 0
2026-01-28 10:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e with identifier: CE51434
2026-01-28 10:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f00d3e-b6df-5aa0-ab3d-5bda450a783e with scrape type 2
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f00d3e-b6df-5aa0-ab3d-5bda450a783e with scrape type 2
2026-01-28 10:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e, identifier: CE51434
2026-01-28 10:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead4f267-f4e2-56e3-bc13-e06555169308 with identifier: WP98796
2026-01-28 10:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead4f267-f4e2-56e3-bc13-e06555169308 with scrape type 1
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ead4f267-f4e2-56e3-bc13-e06555169308
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_e7256db5801e37423e77faa5799322be.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e7256db5801e37423e77faa5799322be.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_55bf9652ce7a89998c63647ed35234c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_55bf9652ce7a89998c63647ed35234c6.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_cf8e1df775bd3d9c3cad368c86383e13.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_cf8e1df775bd3d9c3cad368c86383e13.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_de1f6fb9b1f14000240b3d94db0f1131.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_de1f6fb9b1f14000240b3d94db0f1131.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_e8eb89e1310234b112045c34909999d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e8eb89e1310234b112045c34909999d6.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_4ddf93e6fbccce0727a4c93c6de0d19c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_4ddf93e6fbccce0727a4c93c6de0d19c.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_f4cbf4d40396924607f2a577138a0da9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_f4cbf4d40396924607f2a577138a0da9.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_c4672fedd8facb4b550dab5cb1805eeb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c4672fedd8facb4b550dab5cb1805eeb.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_1e3cb024febe83fbb04bdc936bd7a224.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_1e3cb024febe83fbb04bdc936bd7a224.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_57777b4a7d4ff0048ee664e39234d79f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_57777b4a7d4ff0048ee664e39234d79f.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_07e480ea242bd5d5bcc1c1908c02ceab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_07e480ea242bd5d5bcc1c1908c02ceab.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_83eb416f641e1c59e0a2bc66db0f5db8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_83eb416f641e1c59e0a2bc66db0f5db8.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_d83702de2721a076fe8257e412e40f26.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d83702de2721a076fe8257e412e40f26.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_c98f4c62a5e978a5789a46007eaea352.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c98f4c62a5e978a5789a46007eaea352.jpg already downloaded
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F36%252F043615fc4eccd91bed31b1dbe75a3e1e%252Fpa%252FWP98796_d3f3b35ed76c114dab5778688b7be37f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d3f3b35ed76c114dab5778688b7be37f.jpg already downloaded
2026-01-28 10:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ead4f267-f4e2-56e3-bc13-e06555169308, identifier: WP98796
2026-01-28 10:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e with identifier: CE51434
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e with identifier: CE51434
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156906 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156906
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e spider: auto1.it
2026-01-28 10:03:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 15f00d3e-b6df-5aa0-ab3d-5bda450a783e due to rule: high_mileage_for_country.json, error: 156906 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156906
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:45:44Z',
 'fuel_type': 'petrol',
 'id': '15f00d3e-b6df-5aa0-ab3d-5bda450a783e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE51434',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 156906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2020}
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE51434%27 HTTP/1.1" 200 None
2026-01-28 10:03:49 [auto1.it] INFO: Saving data for CE51434: {'auction_closing_time': 1769705144.0, 'created_time': 1768421099.896898, 'last_price_update_time': 1769594629.285916}
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE51434') HTTP/1.1" 204 0
2026-01-28 10:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ead4f267-f4e2-56e3-bc13-e06555169308 with identifier: WP98796
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ead4f267-f4e2-56e3-bc13-e06555169308 with identifier: WP98796
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162162 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162162
2026-01-28 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ead4f267-f4e2-56e3-bc13-e06555169308 spider: auto1.it
2026-01-28 10:03:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ead4f267-f4e2-56e3-bc13-e06555169308 due to rule: high_mileage_for_country.json, error: 162162 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162162
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:19:14Z',
 'fuel_type': 'diesel',
 'id': 'ead4f267-f4e2-56e3-bc13-e06555169308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP98796',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 162162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e7256db5801e37423e77faa5799322be.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_55bf9652ce7a89998c63647ed35234c6.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_cf8e1df775bd3d9c3cad368c86383e13.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_de1f6fb9b1f14000240b3d94db0f1131.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e8eb89e1310234b112045c34909999d6.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_4ddf93e6fbccce0727a4c93c6de0d19c.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_f4cbf4d40396924607f2a577138a0da9.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c4672fedd8facb4b550dab5cb1805eeb.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_1e3cb024febe83fbb04bdc936bd7a224.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_57777b4a7d4ff0048ee664e39234d79f.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_07e480ea242bd5d5bcc1c1908c02ceab.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_83eb416f641e1c59e0a2bc66db0f5db8.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d83702de2721a076fe8257e412e40f26.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c98f4c62a5e978a5789a46007eaea352.jpg',
                'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d3f3b35ed76c114dab5778688b7be37f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e7256db5801e37423e77faa5799322be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_55bf9652ce7a89998c63647ed35234c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_cf8e1df775bd3d9c3cad368c86383e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_de1f6fb9b1f14000240b3d94db0f1131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_e8eb89e1310234b112045c34909999d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_4ddf93e6fbccce0727a4c93c6de0d19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_f4cbf4d40396924607f2a577138a0da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c4672fedd8facb4b550dab5cb1805eeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_1e3cb024febe83fbb04bdc936bd7a224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_57777b4a7d4ff0048ee664e39234d79f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_07e480ea242bd5d5bcc1c1908c02ceab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_83eb416f641e1c59e0a2bc66db0f5db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d83702de2721a076fe8257e412e40f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_c98f4c62a5e978a5789a46007eaea352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead4f267-f4e2-56e3-bc13-e06555169308/ead4f267-f4e2-56e3-bc13-e06555169308_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/36/043615fc4eccd91bed31b1dbe75a3e1e/pa/WP98796_d3f3b35ed76c114dab5778688b7be37f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP98796%27 HTTP/1.1" 200 None
2026-01-28 10:03:49 [auto1.it] INFO: Saving data for WP98796: {'created_time': 1769594629.549308, 'last_price_update_time': 1769594629.54932, 'auction_closing_time': 1769703554.0}
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP98796') HTTP/1.1" 204 0
2026-01-28 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR00110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:04:43 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 9 pages/min), scraped 66 items (at 3 items/min)
2026-01-28 10:05:43 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 0 pages/min), scraped 66 items (at 0 items/min)
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.065(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.546387903812863 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.506(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.396297168518091 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.514(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.916374504904655 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.514(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.9940075830440485 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.515(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.223974318781611 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.516(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.609287939070265 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.517(s), this was the 1st time calling it.
2026-01-28 10:05:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.099432951434419 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK02214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL71823> (referer: https://www.auto1.com/v1/car-details-view/CL71823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT54414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe with identifier: CL71823
2026-01-28 10:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe with scrape type 1
2026-01-28 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_9f7363063ef063b86a5282d8cfbd8f63.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_9f7363063ef063b86a5282d8cfbd8f63.jpg already downloaded
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_172a560a2b05dfb7785638908a03dd61.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_172a560a2b05dfb7785638908a03dd61.jpg already downloaded
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_7d9b591c74278ab46daa62f46b5c2caf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d9b591c74278ab46daa62f46b5c2caf.jpg already downloaded
2026-01-28 10:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_ffa35644d90e6f8914afbd89566f9aa2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ffa35644d90e6f8914afbd89566f9aa2.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_d9e8df5950e52eb5f214407210111506.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_d9e8df5950e52eb5f214407210111506.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_559576b2f9f66e78081458b273b98abf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_559576b2f9f66e78081458b273b98abf.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_f3a044b20c16b0919cdfc3a0464473c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f3a044b20c16b0919cdfc3a0464473c1.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_6f045921b630098a57f1344f1a04dd2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_6f045921b630098a57f1344f1a04dd2f.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_7d5a85b8f592677bc5df193e19b4541d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d5a85b8f592677bc5df193e19b4541d.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_0bc5a9e174fe909ed6c89ce756621cdb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_0bc5a9e174fe909ed6c89ce756621cdb.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_f0e02a8f1f5b00ddc854858a34fbfb2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f0e02a8f1f5b00ddc854858a34fbfb2e.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_80b3a022b73ec073b4749c5789d30ea3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_80b3a022b73ec073b4749c5789d30ea3.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_4487389b482962d3794f61747c0f9959.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_4487389b482962d3794f61747c0f9959.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_8ed6972db2bec380a3a161a2c42674cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_8ed6972db2bec380a3a161a2c42674cb.jpg already downloaded
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fba%252Fbbba3574481c155ecae712caea9e87f4%252Fpa%252FCL71823_ca2172200eab1a8919cd33e53925fe97.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ca2172200eab1a8919cd33e53925fe97.jpg already downloaded
2026-01-28 10:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe, identifier: CL71823
2026-01-28 10:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe with identifier: CL71823
2026-01-28 10:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe with identifier: CL71823
2026-01-28 10:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184309 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184309
2026-01-28 10:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe spider: auto1.it
2026-01-28 10:06:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe due to rule: high_mileage_for_country.json, error: 184309 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184309
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:19:02Z',
 'fuel_type': 'diesel',
 'id': '098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL71823',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 184309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_9f7363063ef063b86a5282d8cfbd8f63.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_172a560a2b05dfb7785638908a03dd61.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d9b591c74278ab46daa62f46b5c2caf.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ffa35644d90e6f8914afbd89566f9aa2.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_d9e8df5950e52eb5f214407210111506.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_559576b2f9f66e78081458b273b98abf.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f3a044b20c16b0919cdfc3a0464473c1.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_6f045921b630098a57f1344f1a04dd2f.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d5a85b8f592677bc5df193e19b4541d.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_0bc5a9e174fe909ed6c89ce756621cdb.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f0e02a8f1f5b00ddc854858a34fbfb2e.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_80b3a022b73ec073b4749c5789d30ea3.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_4487389b482962d3794f61747c0f9959.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_8ed6972db2bec380a3a161a2c42674cb.jpg',
                'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ca2172200eab1a8919cd33e53925fe97.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_9f7363063ef063b86a5282d8cfbd8f63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_172a560a2b05dfb7785638908a03dd61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d9b591c74278ab46daa62f46b5c2caf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ffa35644d90e6f8914afbd89566f9aa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_d9e8df5950e52eb5f214407210111506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_559576b2f9f66e78081458b273b98abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997840,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f3a044b20c16b0919cdfc3a0464473c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_6f045921b630098a57f1344f1a04dd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_7d5a85b8f592677bc5df193e19b4541d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_0bc5a9e174fe909ed6c89ce756621cdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_f0e02a8f1f5b00ddc854858a34fbfb2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_80b3a022b73ec073b4749c5789d30ea3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_4487389b482962d3794f61747c0f9959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_8ed6972db2bec380a3a161a2c42674cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe/098ef1e0-cbe6-5e46-8a5e-9c83c9e467fe_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/ba/bbba3574481c155ecae712caea9e87f4/pa/CL71823_ca2172200eab1a8919cd33e53925fe97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Executive',
 'transmission': 'automatic',
 'trim': 'Q4 Executive',
 'year': 2019}
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL71823%27 HTTP/1.1" 200 None
2026-01-28 10:06:05 [auto1.it] INFO: Saving data for CL71823: {'auction_closing_time': 1769703542.0, 'created_time': 1769594765.60525, 'last_price_update_time': 1769594765.605263}
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL71823') HTTP/1.1" 204 0
2026-01-28 10:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK45302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB13849> (referer: https://www.auto1.com/v1/car-details-view/XB13849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1cd472d-159c-5eeb-bc44-86e55b07c1f3 with identifier: XB13849
2026-01-28 10:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1cd472d-159c-5eeb-bc44-86e55b07c1f3 with scrape type 2
2026-01-28 10:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1cd472d-159c-5eeb-bc44-86e55b07c1f3 with scrape type 2
2026-01-28 10:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1cd472d-159c-5eeb-bc44-86e55b07c1f3, identifier: XB13849
2026-01-28 10:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1cd472d-159c-5eeb-bc44-86e55b07c1f3 with identifier: XB13849
2026-01-28 10:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1cd472d-159c-5eeb-bc44-86e55b07c1f3 with identifier: XB13849
2026-01-28 10:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 10:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c1cd472d-159c-5eeb-bc44-86e55b07c1f3 spider: auto1.it
2026-01-28 10:06:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c1cd472d-159c-5eeb-bc44-86e55b07c1f3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:35Z',
 'fuel_type': 'diesel',
 'id': 'c1cd472d-159c-5eeb-bc44-86e55b07c1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB13849',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 92714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-16',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi EcoBlue L1 Trend',
 'transmission': 'manual',
 'trim': 'L1 Trend',
 'year': 2022}
2026-01-28 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB13849%27 HTTP/1.1" 200 None
2026-01-28 10:06:06 [auto1.it] INFO: Saving data for XB13849: {'auction_closing_time': 1769704235.0, 'created_time': 1769458075.842654, 'last_price_update_time': 1769594766.156697}
2026-01-28 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XB13849') HTTP/1.1" 204 0
2026-01-28 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE91264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK57569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LN32386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM48697> (referer: https://www.auto1.com/v1/car-details-view/CM48697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN28009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84abb257-db1a-5ca4-bc8b-e0f83da773c2 with identifier: CM48697
2026-01-28 10:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84abb257-db1a-5ca4-bc8b-e0f83da773c2 with scrape type 2
2026-01-28 10:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84abb257-db1a-5ca4-bc8b-e0f83da773c2 with scrape type 2
2026-01-28 10:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84abb257-db1a-5ca4-bc8b-e0f83da773c2, identifier: CM48697
2026-01-28 10:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84abb257-db1a-5ca4-bc8b-e0f83da773c2 with identifier: CM48697
2026-01-28 10:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84abb257-db1a-5ca4-bc8b-e0f83da773c2 with identifier: CM48697
2026-01-28 10:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 10:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 84abb257-db1a-5ca4-bc8b-e0f83da773c2 spider: auto1.it
2026-01-28 10:06:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 84abb257-db1a-5ca4-bc8b-e0f83da773c2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:06:52Z',
 'fuel_type': 'diesel',
 'id': '84abb257-db1a-5ca4-bc8b-e0f83da773c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM48697',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 107512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-27',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Titanium',
 'transmission': 'manual',
 'trim': '320 L1 Titanium',
 'year': 2022}
2026-01-28 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM48697%27 HTTP/1.1" 200 None
2026-01-28 10:06:07 [auto1.it] INFO: Saving data for CM48697: {'auction_closing_time': 1769702812.0, 'created_time': 1769458068.979053, 'last_price_update_time': 1769594767.43846}
2026-01-28 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM48697') HTTP/1.1" 204 0
2026-01-28 10:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ34330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK02214> (referer: https://www.auto1.com/v1/car-details-view/DK02214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a984fb0-6766-58ae-b34b-a209acdef870 with identifier: DK02214
2026-01-28 10:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a984fb0-6766-58ae-b34b-a209acdef870 with scrape type 2
2026-01-28 10:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a984fb0-6766-58ae-b34b-a209acdef870 with scrape type 2
2026-01-28 10:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a984fb0-6766-58ae-b34b-a209acdef870, identifier: DK02214
2026-01-28 10:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a984fb0-6766-58ae-b34b-a209acdef870 with identifier: DK02214
2026-01-28 10:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a984fb0-6766-58ae-b34b-a209acdef870 with identifier: DK02214
2026-01-28 10:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a984fb0-6766-58ae-b34b-a209acdef870 with identifier: DK02214 to the API
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK02214>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:47:32Z',
 'fuel_type': 'petrol',
 'id': '5a984fb0-6766-58ae-b34b-a209acdef870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK02214',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 82796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK02214%27 HTTP/1.1" 200 None
2026-01-28 10:06:09 [auto1.it] INFO: Saving data for DK02214: {'auction_closing_time': 1769705252.0, 'created_time': 1768334694.09646, 'last_price_update_time': 1769594769.851023}
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK02214') HTTP/1.1" 204 0
2026-01-28 10:06:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.325(s), this was the 1st time calling it.
2026-01-28 10:06:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.499682292242189 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW25674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS07173> (referer: https://www.auto1.com/v1/car-details-view/XS07173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9907579-162c-5a82-9a5b-4cfd89042b3d with identifier: XS07173
2026-01-28 10:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9907579-162c-5a82-9a5b-4cfd89042b3d with scrape type 1
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f9907579-162c-5a82-9a5b-4cfd89042b3d
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_cd65e36dab12a949fadb5d909121324d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_cd65e36dab12a949fadb5d909121324d.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_ca2c421985fa75488ab652d0db450b53.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_ca2c421985fa75488ab652d0db450b53.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_04464fa24e460a54cb50dade0ca420f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_04464fa24e460a54cb50dade0ca420f6.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_48fef250363ee9261d46741aabbb433e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_48fef250363ee9261d46741aabbb433e.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_239585893be80abf2e231bb625268463.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_239585893be80abf2e231bb625268463.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_904ab8b1f6f9c5aebf8a9981bfe0cb7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_904ab8b1f6f9c5aebf8a9981bfe0cb7a.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_171913d3947ff8d3b20c29e94048f56b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_171913d3947ff8d3b20c29e94048f56b.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_4672fc1b599c627701977b5ac95f7d9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_4672fc1b599c627701977b5ac95f7d9d.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_3dc786970f5399b307fa2d9e248db0bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_3dc786970f5399b307fa2d9e248db0bb.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_8b0e785d14ef99bd9d327c5e9c14531c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_8b0e785d14ef99bd9d327c5e9c14531c.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_892a4c5d07f1f75a5885b5de828efe6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_892a4c5d07f1f75a5885b5de828efe6b.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_232dc04680589b4e3279896550918095.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_232dc04680589b4e3279896550918095.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_0dfae3966eb3dc0ed0abb3c4d5a82866.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_0dfae3966eb3dc0ed0abb3c4d5a82866.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_e61f5b41cd37e77e26cdf15f0cb478fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_e61f5b41cd37e77e26cdf15f0cb478fa.jpg already downloaded
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fa6%252F52a68c9e3536c3bf870cd4b5d6f0c9ee%252Fpa%252FXS07173_fa91e610db443fb4e84433106215a396.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_fa91e610db443fb4e84433106215a396.jpg already downloaded
2026-01-28 10:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9907579-162c-5a82-9a5b-4cfd89042b3d, identifier: XS07173
2026-01-28 10:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9907579-162c-5a82-9a5b-4cfd89042b3d with identifier: XS07173
2026-01-28 10:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9907579-162c-5a82-9a5b-4cfd89042b3d with identifier: XS07173
2026-01-28 10:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9907579-162c-5a82-9a5b-4cfd89042b3d with identifier: XS07173 to the API
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS07173>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:56:55Z',
 'fuel_type': 'petrol',
 'id': 'f9907579-162c-5a82-9a5b-4cfd89042b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07173',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 93164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_cd65e36dab12a949fadb5d909121324d.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_ca2c421985fa75488ab652d0db450b53.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_04464fa24e460a54cb50dade0ca420f6.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_48fef250363ee9261d46741aabbb433e.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_239585893be80abf2e231bb625268463.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_904ab8b1f6f9c5aebf8a9981bfe0cb7a.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_171913d3947ff8d3b20c29e94048f56b.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_4672fc1b599c627701977b5ac95f7d9d.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_3dc786970f5399b307fa2d9e248db0bb.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_8b0e785d14ef99bd9d327c5e9c14531c.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_892a4c5d07f1f75a5885b5de828efe6b.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_232dc04680589b4e3279896550918095.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_0dfae3966eb3dc0ed0abb3c4d5a82866.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_e61f5b41cd37e77e26cdf15f0cb478fa.jpg',
                'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_fa91e610db443fb4e84433106215a396.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_cd65e36dab12a949fadb5d909121324d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_ca2c421985fa75488ab652d0db450b53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_04464fa24e460a54cb50dade0ca420f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_48fef250363ee9261d46741aabbb433e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_239585893be80abf2e231bb625268463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_904ab8b1f6f9c5aebf8a9981bfe0cb7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_171913d3947ff8d3b20c29e94048f56b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_4672fc1b599c627701977b5ac95f7d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_3dc786970f5399b307fa2d9e248db0bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_8b0e785d14ef99bd9d327c5e9c14531c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_892a4c5d07f1f75a5885b5de828efe6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_232dc04680589b4e3279896550918095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_0dfae3966eb3dc0ed0abb3c4d5a82866.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_e61f5b41cd37e77e26cdf15f0cb478fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9907579-162c-5a82-9a5b-4cfd89042b3d/f9907579-162c-5a82-9a5b-4cfd89042b3d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/a6/52a68c9e3536c3bf870cd4b5d6f0c9ee/pa/XS07173_fa91e610db443fb4e84433106215a396.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
 'transmission': 'automatic',
 'trim': 'Limited 4x2',
 'year': 2019}
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS07173%27 HTTP/1.1" 200 None
2026-01-28 10:06:12 [auto1.it] INFO: Saving data for XS07173: {'created_time': 1769594772.905511, 'last_price_update_time': 1769594772.905526, 'auction_closing_time': 1769705815.0}
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS07173') HTTP/1.1" 204 0
2026-01-28 10:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE57930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB59491> (referer: https://www.auto1.com/v1/car-details-view/UB59491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689d0bba-d3bf-557e-b86e-f7f39153ff00 with identifier: UB59491
2026-01-28 10:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d0bba-d3bf-557e-b86e-f7f39153ff00 with scrape type 2
2026-01-28 10:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689d0bba-d3bf-557e-b86e-f7f39153ff00 with scrape type 2
2026-01-28 10:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 689d0bba-d3bf-557e-b86e-f7f39153ff00, identifier: UB59491
2026-01-28 10:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 689d0bba-d3bf-557e-b86e-f7f39153ff00 with identifier: UB59491
2026-01-28 10:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 689d0bba-d3bf-557e-b86e-f7f39153ff00 with identifier: UB59491
2026-01-28 10:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 689d0bba-d3bf-557e-b86e-f7f39153ff00 with identifier: UB59491 to the API
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB59491>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-01-29T16:26:21Z',
 'fuel_type': 'diesel',
 'id': '689d0bba-d3bf-557e-b86e-f7f39153ff00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB59491',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 25829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q8 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2025}
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB59491%27 HTTP/1.1" 200 None
2026-01-28 10:06:16 [auto1.it] INFO: Saving data for UB59491: {'auction_closing_time': 1769703981.0, 'created_time': 1769199407.48602, 'last_price_update_time': 1769594776.745502}
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB59491') HTTP/1.1" 204 0
2026-01-28 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ50946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR00583> (referer: https://www.auto1.com/v1/car-details-view/NR00583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81e1e931-848e-575c-af4b-750a45fef28d with identifier: NR00583
2026-01-28 10:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81e1e931-848e-575c-af4b-750a45fef28d with scrape type 1
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 81e1e931-848e-575c-af4b-750a45fef28d
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_916201e189931dc582833de4dfa47930.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_916201e189931dc582833de4dfa47930.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_aef2ba415404dc9e6e8eb68ed3c1a01c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_aef2ba415404dc9e6e8eb68ed3c1a01c.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_9c078604a3326bf7d393257daa239ae1.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9c078604a3326bf7d393257daa239ae1.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_bcfd933915bc544400f9d24db481672d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_bcfd933915bc544400f9d24db481672d.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_ceee3f0a0b852ba95fda61a9a79469c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_ceee3f0a0b852ba95fda61a9a79469c6.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_877223678d5d33f90d15252910d0819e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_877223678d5d33f90d15252910d0819e.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_9412c4c069e5b2202a83a0a122eda8eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9412c4c069e5b2202a83a0a122eda8eb.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_4a01b11770cf082999b4354ece16acf0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_4a01b11770cf082999b4354ece16acf0.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_e38276176019a3c3c0888fd71162aa67.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_e38276176019a3c3c0888fd71162aa67.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_18083ff5c2e36ba263d5fc96788322df.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_18083ff5c2e36ba263d5fc96788322df.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_644dc7bdfa8fd2e872e3adb715c21001.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_644dc7bdfa8fd2e872e3adb715c21001.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_c956c3d1e4cb74470e52274dd17c640a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_c956c3d1e4cb74470e52274dd17c640a.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_7c3ab00b547b561a534c7bdc1c99f9f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_7c3ab00b547b561a534c7bdc1c99f9f4.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_571453df99531a40187e1b8d82fefd6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_571453df99531a40187e1b8d82fefd6e.jpg already downloaded
2026-01-28 10:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F29%252F1029bfca73ce0797dc22a055919fd38a%252Fpa%252FNR00583_a15a57d891fb9e96207612009027109d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_a15a57d891fb9e96207612009027109d.jpg already downloaded
2026-01-28 10:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81e1e931-848e-575c-af4b-750a45fef28d, identifier: NR00583
2026-01-28 10:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81e1e931-848e-575c-af4b-750a45fef28d with identifier: NR00583
2026-01-28 10:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81e1e931-848e-575c-af4b-750a45fef28d with identifier: NR00583
2026-01-28 10:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165410
2026-01-28 10:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 81e1e931-848e-575c-af4b-750a45fef28d spider: auto1.it
2026-01-28 10:06:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 81e1e931-848e-575c-af4b-750a45fef28d due to rule: high_mileage_for_country.json, error: 165410 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165410
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:58:09Z',
 'fuel_type': 'diesel',
 'id': '81e1e931-848e-575c-af4b-750a45fef28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR00583',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 165410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_916201e189931dc582833de4dfa47930.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_aef2ba415404dc9e6e8eb68ed3c1a01c.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9c078604a3326bf7d393257daa239ae1.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_bcfd933915bc544400f9d24db481672d.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_ceee3f0a0b852ba95fda61a9a79469c6.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_877223678d5d33f90d15252910d0819e.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9412c4c069e5b2202a83a0a122eda8eb.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_4a01b11770cf082999b4354ece16acf0.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_e38276176019a3c3c0888fd71162aa67.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_18083ff5c2e36ba263d5fc96788322df.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_644dc7bdfa8fd2e872e3adb715c21001.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_c956c3d1e4cb74470e52274dd17c640a.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_7c3ab00b547b561a534c7bdc1c99f9f4.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_571453df99531a40187e1b8d82fefd6e.jpg',
                'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_a15a57d891fb9e96207612009027109d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_916201e189931dc582833de4dfa47930.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_aef2ba415404dc9e6e8eb68ed3c1a01c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9c078604a3326bf7d393257daa239ae1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_bcfd933915bc544400f9d24db481672d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_ceee3f0a0b852ba95fda61a9a79469c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_877223678d5d33f90d15252910d0819e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2715755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_9412c4c069e5b2202a83a0a122eda8eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_4a01b11770cf082999b4354ece16acf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620206,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_e38276176019a3c3c0888fd71162aa67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_18083ff5c2e36ba263d5fc96788322df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_644dc7bdfa8fd2e872e3adb715c21001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_c956c3d1e4cb74470e52274dd17c640a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_7c3ab00b547b561a534c7bdc1c99f9f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_571453df99531a40187e1b8d82fefd6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81e1e931-848e-575c-af4b-750a45fef28d/81e1e931-848e-575c-af4b-750a45fef28d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/29/1029bfca73ce0797dc22a055919fd38a/pa/NR00583_a15a57d891fb9e96207612009027109d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-01-28 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR00583%27 HTTP/1.1" 200 None
2026-01-28 10:06:42 [auto1.it] INFO: Saving data for NR00583: {'auction_closing_time': 1769705889.0, 'created_time': 1769594802.354952, 'last_price_update_time': 1769594802.354962}
2026-01-28 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR00583') HTTP/1.1" 204 0
2026-01-28 10:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP41333> (referer: https://www.auto1.com/v1/car-details-view/MP41333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with identifier: MP41333
2026-01-28 10:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with scrape type 2
2026-01-28 10:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with scrape type 2
2026-01-28 10:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1aa3f697-8ef1-59b0-b5ba-add8a426f19c, identifier: MP41333
2026-01-28 10:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with identifier: MP41333
2026-01-28 10:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with identifier: MP41333
2026-01-28 10:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1aa3f697-8ef1-59b0-b5ba-add8a426f19c with identifier: MP41333 to the API
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP41333>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.3L',
 'engine_horse_power': 151,
 'expiration_date': '2026-01-29T16:16:23Z',
 'fuel_type': 'petrol',
 'id': '1aa3f697-8ef1-59b0-b5ba-add8a426f19c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP41333',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 122113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo City Cross',
 'transmission': 'automatic',
 'trim': 'City Cross',
 'year': 2019}
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP41333%27 HTTP/1.1" 200 None
2026-01-28 10:06:43 [auto1.it] INFO: Saving data for MP41333: {'auction_closing_time': 1769703383.0, 'created_time': 1768298807.09351, 'last_price_update_time': 1769594803.829981}
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP41333') HTTP/1.1" 204 0
2026-01-28 10:06:43 [scrapy.extensions.logstats] INFO: Crawled 231 pages (at 19 pages/min), scraped 70 items (at 4 items/min)
2026-01-28 10:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK45302> (referer: https://www.auto1.com/v1/car-details-view/NK45302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-01-28 10:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with scrape type 2
2026-01-28 10:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with scrape type 2
2026-01-28 10:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b53d309-490f-55fc-b94a-6197b1b7f6a4, identifier: NK45302
2026-01-28 10:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-01-28 10:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 with identifier: NK45302
2026-01-28 10:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'v-klasse' containing 'v-klasse'
2026-01-28 10:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 spider: auto1.it
2026-01-28 10:06:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3b53d309-490f-55fc-b94a-6197b1b7f6a4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'v-klasse' containing 'v-klasse'
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:48:22Z',
 'fuel_type': 'diesel',
 'id': '3b53d309-490f-55fc-b94a-6197b1b7f6a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK45302',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 91775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Avantgarde',
 'year': 2019}
2026-01-28 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-01-28 10:06:47 [auto1.it] INFO: Saving data for NK45302: {'auction_closing_time': 1769705302.0, 'created_time': 1768300780.456535, 'last_price_update_time': 1769594807.71342}
2026-01-28 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK45302') HTTP/1.1" 204 0
2026-01-28 10:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN28009> (referer: https://www.auto1.com/v1/car-details-view/EN28009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e5283b-5273-553a-b5da-e222ce071c98 with identifier: EN28009
2026-01-28 10:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e5283b-5273-553a-b5da-e222ce071c98 with scrape type 2
2026-01-28 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e5283b-5273-553a-b5da-e222ce071c98 with scrape type 2
2026-01-28 10:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40e5283b-5273-553a-b5da-e222ce071c98, identifier: EN28009
2026-01-28 10:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40e5283b-5273-553a-b5da-e222ce071c98 with identifier: EN28009
2026-01-28 10:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40e5283b-5273-553a-b5da-e222ce071c98 with identifier: EN28009
2026-01-28 10:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40e5283b-5273-553a-b5da-e222ce071c98 with identifier: EN28009 to the API
2026-01-28 10:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN28009>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:34:37Z',
 'fuel_type': 'petrol',
 'id': '40e5283b-5273-553a-b5da-e222ce071c98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN28009',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 44985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2021}
2026-01-28 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN28009%27 HTTP/1.1" 200 None
2026-01-28 10:06:57 [auto1.it] INFO: Saving data for EN28009: {'auction_closing_time': 1769704477.0, 'created_time': 1769198940.593964, 'last_price_update_time': 1769594817.081236}
2026-01-28 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN28009') HTTP/1.1" 204 0
2026-01-28 10:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA82153> (referer: https://www.auto1.com/v1/car-details-view/LA82153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with identifier: LA82153
2026-01-28 10:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with scrape type 2
2026-01-28 10:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with scrape type 2
2026-01-28 10:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa11e2c0-b2de-53a3-820f-66d67fc2fc5e, identifier: LA82153
2026-01-28 10:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with identifier: LA82153
2026-01-28 10:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with identifier: LA82153
2026-01-28 10:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa11e2c0-b2de-53a3-820f-66d67fc2fc5e with identifier: LA82153 to the API
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA82153>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:47:56Z',
 'fuel_type': 'petrol',
 'id': 'fa11e2c0-b2de-53a3-820f-66d67fc2fc5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA82153',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 16017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA82153%27 HTTP/1.1" 200 None
2026-01-28 10:07:04 [auto1.it] INFO: Saving data for LA82153: {'auction_closing_time': 1769705276.0, 'created_time': 1767989148.029499, 'last_price_update_time': 1769594824.954955}
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA82153') HTTP/1.1" 204 0
2026-01-28 10:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW25674> (referer: https://www.auto1.com/v1/car-details-view/KW25674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa34634-79ae-535b-a16e-dddb29aefd9a with identifier: KW25674
2026-01-28 10:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa34634-79ae-535b-a16e-dddb29aefd9a with scrape type 2
2026-01-28 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa34634-79ae-535b-a16e-dddb29aefd9a with scrape type 2
2026-01-28 10:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6aa34634-79ae-535b-a16e-dddb29aefd9a, identifier: KW25674
2026-01-28 10:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6aa34634-79ae-535b-a16e-dddb29aefd9a with identifier: KW25674
2026-01-28 10:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6aa34634-79ae-535b-a16e-dddb29aefd9a with identifier: KW25674
2026-01-28 10:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6aa34634-79ae-535b-a16e-dddb29aefd9a with identifier: KW25674 to the API
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW25674>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:35:34Z',
 'fuel_type': 'diesel',
 'id': '6aa34634-79ae-535b-a16e-dddb29aefd9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW25674',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': '1er',
 'odometer': 58917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW25674%27 HTTP/1.1" 200 None
2026-01-28 10:07:15 [auto1.it] INFO: Saving data for KW25674: {'auction_closing_time': 1769704534.0, 'created_time': 1767384197.42056, 'last_price_update_time': 1769594835.493205}
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW25674') HTTP/1.1" 204 0
2026-01-28 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LN32386> (referer: https://www.auto1.com/v1/car-details-view/LN32386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3274da67-520e-520c-ab76-0f478da41fd8 with identifier: LN32386
2026-01-28 10:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3274da67-520e-520c-ab76-0f478da41fd8 with scrape type 1
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3274da67-520e-520c-ab76-0f478da41fd8
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_5cbb6470048c2fc65f3070a06acc7959.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_5cbb6470048c2fc65f3070a06acc7959.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_f57b7c51e88295984a54f7eb7d506e39.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f57b7c51e88295984a54f7eb7d506e39.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_45cfff10260f1c3f3e24d31d0edaf75a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_45cfff10260f1c3f3e24d31d0edaf75a.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_7f355e0ef9dab8358d75cf8be4b4bc1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_7f355e0ef9dab8358d75cf8be4b4bc1c.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_a3b56e0c2269c3f2acf9d862fb556047.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a3b56e0c2269c3f2acf9d862fb556047.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_77504e225ca692a16ebe26f63fb66ed7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_77504e225ca692a16ebe26f63fb66ed7.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_a5d1ac86e3ceafa4c9a40f16d1f6fedf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a5d1ac86e3ceafa4c9a40f16d1f6fedf.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_809cbcd9ad12f6418d2f8d7f61de909b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_809cbcd9ad12f6418d2f8d7f61de909b.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_63ff94806b7dab521afb5c06aff98cee.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_63ff94806b7dab521afb5c06aff98cee.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_3d17fcbf17799a8705be60a649a1bfc9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3d17fcbf17799a8705be60a649a1bfc9.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_f7407b4bb912747a3a116122097717a4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f7407b4bb912747a3a116122097717a4.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_57ae02bfd09eae136f19bd0d61608615.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_57ae02bfd09eae136f19bd0d61608615.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_3511a9db4d2f420eb76f4e5cb0731d1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3511a9db4d2f420eb76f4e5cb0731d1c.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_dbd9e90d9fb61ef6fdb38b5363dbc708.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_dbd9e90d9fb61ef6fdb38b5363dbc708.jpg already downloaded
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F7f%252F2e7f82918fca4164de9b33603ef3b498%252Fpa%252FLN32386_0ac0cf09617522fbc8725969377c5976.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_0ac0cf09617522fbc8725969377c5976.jpg already downloaded
2026-01-28 10:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3274da67-520e-520c-ab76-0f478da41fd8, identifier: LN32386
2026-01-28 10:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3274da67-520e-520c-ab76-0f478da41fd8 with identifier: LN32386
2026-01-28 10:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3274da67-520e-520c-ab76-0f478da41fd8 with identifier: LN32386
2026-01-28 10:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3274da67-520e-520c-ab76-0f478da41fd8 with identifier: LN32386 to the API
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LN32386>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:55:05Z',
 'fuel_type': 'petrol',
 'id': '3274da67-520e-520c-ab76-0f478da41fd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN32386',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 55754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_5cbb6470048c2fc65f3070a06acc7959.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f57b7c51e88295984a54f7eb7d506e39.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_45cfff10260f1c3f3e24d31d0edaf75a.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_7f355e0ef9dab8358d75cf8be4b4bc1c.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a3b56e0c2269c3f2acf9d862fb556047.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_77504e225ca692a16ebe26f63fb66ed7.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a5d1ac86e3ceafa4c9a40f16d1f6fedf.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_809cbcd9ad12f6418d2f8d7f61de909b.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_63ff94806b7dab521afb5c06aff98cee.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3d17fcbf17799a8705be60a649a1bfc9.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f7407b4bb912747a3a116122097717a4.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_57ae02bfd09eae136f19bd0d61608615.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3511a9db4d2f420eb76f4e5cb0731d1c.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_dbd9e90d9fb61ef6fdb38b5363dbc708.jpg',
                'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_0ac0cf09617522fbc8725969377c5976.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_5cbb6470048c2fc65f3070a06acc7959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f57b7c51e88295984a54f7eb7d506e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_45cfff10260f1c3f3e24d31d0edaf75a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_7f355e0ef9dab8358d75cf8be4b4bc1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a3b56e0c2269c3f2acf9d862fb556047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_77504e225ca692a16ebe26f63fb66ed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_a5d1ac86e3ceafa4c9a40f16d1f6fedf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_809cbcd9ad12f6418d2f8d7f61de909b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_63ff94806b7dab521afb5c06aff98cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3d17fcbf17799a8705be60a649a1bfc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_f7407b4bb912747a3a116122097717a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_57ae02bfd09eae136f19bd0d61608615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_3511a9db4d2f420eb76f4e5cb0731d1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_dbd9e90d9fb61ef6fdb38b5363dbc708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3274da67-520e-520c-ab76-0f478da41fd8/3274da67-520e-520c-ab76-0f478da41fd8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/7f/2e7f82918fca4164de9b33603ef3b498/pa/LN32386_0ac0cf09617522fbc8725969377c5976.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-01-28 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN32386%27 HTTP/1.1" 200 None
2026-01-28 10:07:19 [auto1.it] INFO: Saving data for LN32386: {'auction_closing_time': 1769705705.0, 'created_time': 1769594839.077511, 'last_price_update_time': 1769594839.077523}
2026-01-28 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN32386') HTTP/1.1" 204 0
2026-01-28 10:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT54414> (referer: https://www.auto1.com/v1/car-details-view/CT54414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-01-28 10:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d77856d-55f7-5137-bf4e-494229a04a7d with scrape type 1
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3d77856d-55f7-5137-bf4e-494229a04a7d
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_fa783b9e4884881ddb674c1334cf8885.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_fa783b9e4884881ddb674c1334cf8885.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_1b566c9444fd36a22b285f79929c3a02.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_1b566c9444fd36a22b285f79929c3a02.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_bde84519a452e3819d22399c4eb82b80.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_bde84519a452e3819d22399c4eb82b80.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_408b4dc314d698beb7a85663a27a4966.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_408b4dc314d698beb7a85663a27a4966.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_47d0ef9ff75b158f23e4b1d288007a7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_47d0ef9ff75b158f23e4b1d288007a7a.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_9e93514e1551825ba42fabfcfcfb6872.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_9e93514e1551825ba42fabfcfcfb6872.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_f13caac6fd3cdb2ccf798f398086cff3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_f13caac6fd3cdb2ccf798f398086cff3.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_049ca5e7f45dbeee103a45bc1a29359b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_049ca5e7f45dbeee103a45bc1a29359b.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_d78ef48153893ab281874387926e3177.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_d78ef48153893ab281874387926e3177.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_a10d6937ced299ab207269dbc9d6ba5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_a10d6937ced299ab207269dbc9d6ba5f.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_b5cee60afab25f7f6bcbfed6266883b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b5cee60afab25f7f6bcbfed6266883b6.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_c510b39f8ae4cfbd88f8defbbd4f519a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_c510b39f8ae4cfbd88f8defbbd4f519a.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_4b19c06e3f5d3d6be186f51c33b89c7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_4b19c06e3f5d3d6be186f51c33b89c7c.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_2a78217223899364cc2dcc2de30f0a87.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_2a78217223899364cc2dcc2de30f0a87.jpg already downloaded
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fd3%252Fe6d368e3ae9155516464f47d9e835ac9%252Fpa%252FCT54414_b4ce5fb72adbbee83e4a0de26d90efac.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b4ce5fb72adbbee83e4a0de26d90efac.jpg already downloaded
2026-01-28 10:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d77856d-55f7-5137-bf4e-494229a04a7d, identifier: CT54414
2026-01-28 10:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-01-28 10:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414
2026-01-28 10:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d77856d-55f7-5137-bf4e-494229a04a7d with identifier: CT54414 to the API
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CT54414>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:09:59Z',
 'fuel_type': 'hybrid',
 'id': '3d77856d-55f7-5137-bf4e-494229a04a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54414',
 'listing': 'auction',
 'location': 'IT, Desenzano del Garda',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 90861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_fa783b9e4884881ddb674c1334cf8885.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_1b566c9444fd36a22b285f79929c3a02.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_bde84519a452e3819d22399c4eb82b80.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_408b4dc314d698beb7a85663a27a4966.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_47d0ef9ff75b158f23e4b1d288007a7a.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_9e93514e1551825ba42fabfcfcfb6872.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_f13caac6fd3cdb2ccf798f398086cff3.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_049ca5e7f45dbeee103a45bc1a29359b.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_d78ef48153893ab281874387926e3177.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_a10d6937ced299ab207269dbc9d6ba5f.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b5cee60afab25f7f6bcbfed6266883b6.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_c510b39f8ae4cfbd88f8defbbd4f519a.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_4b19c06e3f5d3d6be186f51c33b89c7c.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_2a78217223899364cc2dcc2de30f0a87.jpg',
                'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b4ce5fb72adbbee83e4a0de26d90efac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_fa783b9e4884881ddb674c1334cf8885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_1b566c9444fd36a22b285f79929c3a02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_bde84519a452e3819d22399c4eb82b80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_408b4dc314d698beb7a85663a27a4966.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_47d0ef9ff75b158f23e4b1d288007a7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2511806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_9e93514e1551825ba42fabfcfcfb6872.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_f13caac6fd3cdb2ccf798f398086cff3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_049ca5e7f45dbeee103a45bc1a29359b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_d78ef48153893ab281874387926e3177.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_a10d6937ced299ab207269dbc9d6ba5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b5cee60afab25f7f6bcbfed6266883b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2355532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_c510b39f8ae4cfbd88f8defbbd4f519a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_4b19c06e3f5d3d6be186f51c33b89c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2404004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_2a78217223899364cc2dcc2de30f0a87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d77856d-55f7-5137-bf4e-494229a04a7d/3d77856d-55f7-5137-bf4e-494229a04a7d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/d3/e6d368e3ae9155516464f47d9e835ac9/pa/CT54414_b4ce5fb72adbbee83e4a0de26d90efac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-01-28 10:07:22 [auto1.it] INFO: Saving data for CT54414: {'auction_closing_time': 1769702999.0, 'created_time': 1769594842.19724, 'last_price_update_time': 1769594842.197252}
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT54414') HTTP/1.1" 204 0
2026-01-28 10:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE57930> (referer: https://www.auto1.com/v1/car-details-view/YE57930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129787a3-a5fc-5fd2-9af5-a82be8e1703c with identifier: YE57930
2026-01-28 10:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129787a3-a5fc-5fd2-9af5-a82be8e1703c with scrape type 2
2026-01-28 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129787a3-a5fc-5fd2-9af5-a82be8e1703c with scrape type 2
2026-01-28 10:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 129787a3-a5fc-5fd2-9af5-a82be8e1703c, identifier: YE57930
2026-01-28 10:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 129787a3-a5fc-5fd2-9af5-a82be8e1703c with identifier: YE57930
2026-01-28 10:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 129787a3-a5fc-5fd2-9af5-a82be8e1703c with identifier: YE57930
2026-01-28 10:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 129787a3-a5fc-5fd2-9af5-a82be8e1703c with identifier: YE57930 to the API
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE57930>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:54:39Z',
 'fuel_type': 'petrol',
 'id': '129787a3-a5fc-5fd2-9af5-a82be8e1703c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE57930',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 52503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE57930%27 HTTP/1.1" 200 None
2026-01-28 10:07:22 [auto1.it] INFO: Saving data for YE57930: {'auction_closing_time': 1769705679.0, 'created_time': 1768298490.735622, 'last_price_update_time': 1769594842.929195}
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE57930') HTTP/1.1" 204 0
2026-01-28 10:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE55407> (referer: https://www.auto1.com/v1/car-details-view/EE55407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c08448d-ad22-55f3-8189-bbc615147c40 with identifier: EE55407
2026-01-28 10:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c08448d-ad22-55f3-8189-bbc615147c40 with scrape type 2
2026-01-28 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c08448d-ad22-55f3-8189-bbc615147c40 with scrape type 2
2026-01-28 10:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c08448d-ad22-55f3-8189-bbc615147c40, identifier: EE55407
2026-01-28 10:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c08448d-ad22-55f3-8189-bbc615147c40 with identifier: EE55407
2026-01-28 10:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c08448d-ad22-55f3-8189-bbc615147c40 with identifier: EE55407
2026-01-28 10:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c08448d-ad22-55f3-8189-bbc615147c40 with identifier: EE55407 to the API
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EE55407>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:20:09Z',
 'fuel_type': 'diesel',
 'id': '8c08448d-ad22-55f3-8189-bbc615147c40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE55407',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'BMW',
 'model': '5er',
 'odometer': 34685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE55407%27 HTTP/1.1" 200 None
2026-01-28 10:07:23 [auto1.it] INFO: Saving data for EE55407: {'auction_closing_time': 1769703609.0, 'created_time': 1768816969.637635, 'last_price_update_time': 1769594843.793573}
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE55407') HTTP/1.1" 204 0
2026-01-28 10:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN06043> (referer: https://www.auto1.com/v1/car-details-view/JN06043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accf8a98-13e6-5c28-8beb-a367e56d00bd with identifier: JN06043
2026-01-28 10:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accf8a98-13e6-5c28-8beb-a367e56d00bd with scrape type 1
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item accf8a98-13e6-5c28-8beb-a367e56d00bd
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_4b9fa11071634ed35c18cc0116cf0975.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_4b9fa11071634ed35c18cc0116cf0975.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_fae3e2ea0ddd1c96822539c053ac6b00.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fae3e2ea0ddd1c96822539c053ac6b00.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_f4066586e30b46248723108515ba7414.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_f4066586e30b46248723108515ba7414.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_647ba9f339a10d1a93c98fa471df83d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_647ba9f339a10d1a93c98fa471df83d4.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_c8189e371ab7a87eb823087ccc328aea.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_c8189e371ab7a87eb823087ccc328aea.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_ca27ff248097ec044c6d4fca3150a225.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ca27ff248097ec044c6d4fca3150a225.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_32669a7ade508693f5f4fde97c46ab9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_32669a7ade508693f5f4fde97c46ab9c.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_b32bf93279080aca1d57fa43ba56decc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_b32bf93279080aca1d57fa43ba56decc.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_da301f538951ce9aae70246a572c845e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_da301f538951ce9aae70246a572c845e.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_04412ebf822ee760ebce75001600663f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_04412ebf822ee760ebce75001600663f.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_ff1232dc85a86587de1712245e50ced5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ff1232dc85a86587de1712245e50ced5.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_6c63bf42f05ba81d507e899006b459dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_6c63bf42f05ba81d507e899006b459dd.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_fbda4e9d48d079089dda8af688633213.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fbda4e9d48d079089dda8af688633213.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_dc1487c2fec0f6010d3424e87fe05393.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_dc1487c2fec0f6010d3424e87fe05393.jpg already downloaded
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F56%252Fa25699bedfcbed34ffd44df209908c41%252Fpa%252FJN06043_0ec9894a49d628e3ec96fc98c4d76293.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_0ec9894a49d628e3ec96fc98c4d76293.jpg already downloaded
2026-01-28 10:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: accf8a98-13e6-5c28-8beb-a367e56d00bd, identifier: JN06043
2026-01-28 10:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: accf8a98-13e6-5c28-8beb-a367e56d00bd with identifier: JN06043
2026-01-28 10:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: accf8a98-13e6-5c28-8beb-a367e56d00bd with identifier: JN06043
2026-01-28 10:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: accf8a98-13e6-5c28-8beb-a367e56d00bd with identifier: JN06043 to the API
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN06043>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:56:10Z',
 'fuel_type': 'petrol',
 'id': 'accf8a98-13e6-5c28-8beb-a367e56d00bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN06043',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 36543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_4b9fa11071634ed35c18cc0116cf0975.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fae3e2ea0ddd1c96822539c053ac6b00.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_f4066586e30b46248723108515ba7414.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_647ba9f339a10d1a93c98fa471df83d4.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_c8189e371ab7a87eb823087ccc328aea.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ca27ff248097ec044c6d4fca3150a225.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_32669a7ade508693f5f4fde97c46ab9c.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_b32bf93279080aca1d57fa43ba56decc.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_da301f538951ce9aae70246a572c845e.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_04412ebf822ee760ebce75001600663f.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ff1232dc85a86587de1712245e50ced5.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_6c63bf42f05ba81d507e899006b459dd.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fbda4e9d48d079089dda8af688633213.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_dc1487c2fec0f6010d3424e87fe05393.jpg',
                'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_0ec9894a49d628e3ec96fc98c4d76293.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_4b9fa11071634ed35c18cc0116cf0975.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fae3e2ea0ddd1c96822539c053ac6b00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2395673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_f4066586e30b46248723108515ba7414.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_647ba9f339a10d1a93c98fa471df83d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_c8189e371ab7a87eb823087ccc328aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ca27ff248097ec044c6d4fca3150a225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_32669a7ade508693f5f4fde97c46ab9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_b32bf93279080aca1d57fa43ba56decc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_da301f538951ce9aae70246a572c845e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_04412ebf822ee760ebce75001600663f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3189554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_ff1232dc85a86587de1712245e50ced5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_6c63bf42f05ba81d507e899006b459dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_fbda4e9d48d079089dda8af688633213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_dc1487c2fec0f6010d3424e87fe05393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accf8a98-13e6-5c28-8beb-a367e56d00bd/accf8a98-13e6-5c28-8beb-a367e56d00bd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/56/a25699bedfcbed34ffd44df209908c41/pa/JN06043_0ec9894a49d628e3ec96fc98c4d76293.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2022}
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN06043%27 HTTP/1.1" 200 None
2026-01-28 10:07:30 [auto1.it] INFO: Saving data for JN06043: {'auction_closing_time': 1769705770.0, 'created_time': 1769594850.333051, 'last_price_update_time': 1769594850.333063}
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN06043') HTTP/1.1" 204 0
2026-01-28 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM91888> (referer: https://www.auto1.com/v1/car-details-view/LM91888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd8e2f25-537e-5767-b555-bf77c1740d32 with identifier: LM91888
2026-01-28 10:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd8e2f25-537e-5767-b555-bf77c1740d32 with scrape type 2
2026-01-28 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd8e2f25-537e-5767-b555-bf77c1740d32 with scrape type 2
2026-01-28 10:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd8e2f25-537e-5767-b555-bf77c1740d32, identifier: LM91888
2026-01-28 10:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd8e2f25-537e-5767-b555-bf77c1740d32 with identifier: LM91888
2026-01-28 10:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd8e2f25-537e-5767-b555-bf77c1740d32 with identifier: LM91888
2026-01-28 10:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130546 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130546
2026-01-28 10:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: cd8e2f25-537e-5767-b555-bf77c1740d32 spider: auto1.it
2026-01-28 10:07:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cd8e2f25-537e-5767-b555-bf77c1740d32 due to rule: high_mileage_for_make.json, error: 130546 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    130546
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:15:12Z',
 'fuel_type': 'diesel',
 'id': 'cd8e2f25-537e-5767-b555-bf77c1740d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM91888',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 130546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2018}
2026-01-28 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM91888%27 HTTP/1.1" 200 None
2026-01-28 10:07:31 [auto1.it] INFO: Saving data for LM91888: {'auction_closing_time': 1769703312.0, 'created_time': 1767729708.0941, 'last_price_update_time': 1769594851.82054}
2026-01-28 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM91888') HTTP/1.1" 204 0
2026-01-28 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ50946> (referer: https://www.auto1.com/v1/car-details-view/FJ50946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with identifier: FJ50946
2026-01-28 10:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with scrape type 2
2026-01-28 10:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with scrape type 2
2026-01-28 10:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70598ceb-8f9d-5681-9b21-cc13c12c62a6, identifier: FJ50946
2026-01-28 10:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with identifier: FJ50946
2026-01-28 10:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with identifier: FJ50946
2026-01-28 10:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70598ceb-8f9d-5681-9b21-cc13c12c62a6 with identifier: FJ50946 to the API
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ50946>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:26:07Z',
 'fuel_type': 'diesel',
 'id': '70598ceb-8f9d-5681-9b21-cc13c12c62a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ50946',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 15797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 M-Jet',
 'transmission': 'manual',
 'trim': '',
 'year': 2025}
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ50946%27 HTTP/1.1" 200 None
2026-01-28 10:07:32 [auto1.it] INFO: Saving data for FJ50946: {'auction_closing_time': 1769703967.0, 'created_time': 1767989151.278341, 'last_price_update_time': 1769594852.534605}
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ50946') HTTP/1.1" 204 0
2026-01-28 10:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5150efe471568a53124122a1960c853d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee223250>
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_5150efe471568a53124122a1960c853d.jpg') HTTP/1.1" 204 0
2026-01-28 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5150efe471568a53124122a1960c853d.jpg saved to cache
2026-01-28 10:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f5126390>
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg') HTTP/1.1" 204 0
2026-01-28 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg saved to cache
2026-01-28 10:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_79fa2f308e6a1438d451d63eba587ef2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:07:35 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for WN11922: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: UA54373
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for UA54373: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: AR75288
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for AR75288: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: AM19633
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM19633%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for AM19633: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: LZ66498
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ66498%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for LZ66498: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: WN49537
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN49537%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for WN49537: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: PX31036
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX31036%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for PX31036: 2
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: UP48367
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for UP48367: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: PM87024
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for PM87024: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: KZ89733
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ89733%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for KZ89733: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: NV95469
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV95469%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for NV95469: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: RL99937
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL99937%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for RL99937: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: DN61580
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN61580%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for DN61580: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: XD70855
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for XD70855: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: VG01482
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG01482%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for VG01482: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: NA73854
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA73854%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for NA73854: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: SV83223
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV83223%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for SV83223: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: LA77465
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for LA77465: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: XU61631
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for XU61631: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: AD03373
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for AD03373: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: PP03591
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for PP03591: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: HL10790
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10790%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for HL10790: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: SJ77848
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for SJ77848: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: RE39757
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE39757%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for RE39757: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: JE15416
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for JE15416: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: DR27606
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27606%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for DR27606: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: HG00560
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for HG00560: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: XL96089
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL96089%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for XL96089: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for CD79561: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: UD04779
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for UD04779: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: JF86127
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF86127%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for JF86127: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: AB69922
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB69922%27 HTTP/1.1" 200 None
2026-01-28 10:07:35 [auto1.it] INFO: Scrape type for AB69922: 0
2026-01-28 10:07:35 [auto1.it] INFO: Found listing with ID: GT57275
2026-01-28 10:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for GT57275: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: ZH19679
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH19679%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for ZH19679: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: ML77651
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for ML77651: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: VX57243
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX57243%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for VX57243: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: GC49828
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC49828%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for GC49828: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: CB94956
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB94956%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for CB94956: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: FX49357
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX49357%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for FX49357: 0
2026-01-28 10:07:36 [auto1.it] INFO: Found listing with ID: RR19391
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR19391%27 HTTP/1.1" 200 None
2026-01-28 10:07:36 [auto1.it] INFO: Scrape type for RR19391: 0
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee97790>
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_79fa2f308e6a1438d451d63eba587ef2.jpg') HTTP/1.1" 204 0
2026-01-28 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_79fa2f308e6a1438d451d63eba587ef2.jpg saved to cache
2026-01-28 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_d807178ff24868bdc3090169fd742fb2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:07:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d7310>
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_d807178ff24868bdc3090169fd742fb2.jpg') HTTP/1.1" 204 0
2026-01-28 10:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_d807178ff24868bdc3090169fd742fb2.jpg saved to cache
2026-01-28 10:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR02947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV95315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC57699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK57785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX41967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22b790>
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg') HTTP/1.1" 204 0
2026-01-28 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg saved to cache
2026-01-28 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ94912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:43 [scrapy.extensions.logstats] INFO: Crawled 249 pages (at 18 pages/min), scraped 79 items (at 9 items/min)
2026-01-28 10:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF21484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE21788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX31036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK96429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:49 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: RJ17410
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ17410%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for RJ17410: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: EH01069
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for EH01069: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: BF67818
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF67818%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for BF67818: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: TW52947
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW52947%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for TW52947: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: AB48046
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB48046%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for AB48046: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: TZ58430
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ58430%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for TZ58430: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: ET25388
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for ET25388: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: CA86340
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for CA86340: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: RA25408
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for RA25408: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: FJ70375
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ70375%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for FJ70375: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: UW51000
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for UW51000: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: MJ25733
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ25733%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for MJ25733: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: GB07177
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB07177%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for GB07177: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: ZH94577
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH94577%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for ZH94577: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: PY58438
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for PY58438: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: SA14843
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA14843%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for SA14843: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: KF29080
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF29080%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for KF29080: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: HC32462
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC32462%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for HC32462: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: LX93740
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for LX93740: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: KE15341
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE15341%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for KE15341: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: JU84711
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU84711%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for JU84711: 2
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: KJ26338
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ26338%27 HTTP/1.1" 200 None
2026-01-28 10:07:49 [auto1.it] INFO: Scrape type for KJ26338: 0
2026-01-28 10:07:49 [auto1.it] INFO: Found listing with ID: AV65430
2026-01-28 10:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for AV65430: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: DA44025
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for DA44025: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: PC33365
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC33365%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for PC33365: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: SK38544
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK38544%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for SK38544: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: VH61995
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH61995%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for VH61995: 2
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: VB04697
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04697%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for VB04697: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: WK84125
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK84125%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for WK84125: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: ZX21945
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX21945%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for ZX21945: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: CS53941
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS53941%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for CS53941: 2
2026-01-28 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD10963> (referer: https://www.auto1.com/v1/car-details-view/FD10963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: GZ43068
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ43068%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for GZ43068: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: KS32404
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS32404%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for KS32404: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: FK29975
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for FK29975: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: JN76838
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN76838%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for JN76838: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: VT38292
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT38292%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for VT38292: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: RB81856
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB81856%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for RB81856: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: DJ83260
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ83260%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for DJ83260: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: RW56209
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW56209%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for RW56209: 0
2026-01-28 10:07:50 [auto1.it] INFO: Found listing with ID: FC83835
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC83835%27 HTTP/1.1" 200 None
2026-01-28 10:07:50 [auto1.it] INFO: Scrape type for FC83835: 0
2026-01-28 10:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315577dc-d55f-5085-b5d9-2522fdf13b1a with identifier: FD10963
2026-01-28 10:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315577dc-d55f-5085-b5d9-2522fdf13b1a with scrape type 2
2026-01-28 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 315577dc-d55f-5085-b5d9-2522fdf13b1a with scrape type 2
2026-01-28 10:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 315577dc-d55f-5085-b5d9-2522fdf13b1a, identifier: FD10963
2026-01-28 10:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 315577dc-d55f-5085-b5d9-2522fdf13b1a with identifier: FD10963
2026-01-28 10:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 315577dc-d55f-5085-b5d9-2522fdf13b1a with identifier: FD10963
2026-01-28 10:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 315577dc-d55f-5085-b5d9-2522fdf13b1a with identifier: FD10963 to the API
2026-01-28 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD10963>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:58:06Z',
 'fuel_type': 'hybrid',
 'id': '315577dc-d55f-5085-b5d9-2522fdf13b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD10963',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 3245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
 'transmission': 'automatic',
 'trim': '2WD Trend',
 'year': 2023}
2026-01-28 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD10963%27 HTTP/1.1" 200 None
2026-01-28 10:07:51 [auto1.it] INFO: Saving data for FD10963: {'auction_closing_time': 1769705886.0, 'created_time': 1768334708.418537, 'last_price_update_time': 1769594871.188569}
2026-01-28 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD10963') HTTP/1.1" 204 0
2026-01-28 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV95315> (referer: https://www.auto1.com/v1/car-details-view/XV95315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR02947> (referer: https://www.auto1.com/v1/car-details-view/JR02947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0078a001-545b-5840-a8b3-d3d899a63bc1 with identifier: XV95315
2026-01-28 10:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0078a001-545b-5840-a8b3-d3d899a63bc1 with scrape type 2
2026-01-28 10:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0078a001-545b-5840-a8b3-d3d899a63bc1 with scrape type 2
2026-01-28 10:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0078a001-545b-5840-a8b3-d3d899a63bc1, identifier: XV95315
2026-01-28 10:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0078a001-545b-5840-a8b3-d3d899a63bc1 with identifier: XV95315
2026-01-28 10:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0078a001-545b-5840-a8b3-d3d899a63bc1 with identifier: XV95315
2026-01-28 10:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0078a001-545b-5840-a8b3-d3d899a63bc1 with identifier: XV95315 to the API
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV95315>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:49:40Z',
 'fuel_type': 'hybrid',
 'id': '0078a001-545b-5840-a8b3-d3d899a63bc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV95315',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 9601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active',
 'transmission': 'automatic',
 'trim': '2WD Active',
 'year': 2024}
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV95315%27 HTTP/1.1" 200 None
2026-01-28 10:08:01 [auto1.it] INFO: Saving data for XV95315: {'auction_closing_time': 1769705380.0, 'created_time': 1768853191.373001, 'last_price_update_time': 1769594881.218244}
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV95315') HTTP/1.1" 204 0
2026-01-28 10:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd27161f-0ae1-5786-8cb8-d345e1485a56 with identifier: JR02947
2026-01-28 10:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd27161f-0ae1-5786-8cb8-d345e1485a56 with scrape type 2
2026-01-28 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd27161f-0ae1-5786-8cb8-d345e1485a56 with scrape type 2
2026-01-28 10:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd27161f-0ae1-5786-8cb8-d345e1485a56, identifier: JR02947
2026-01-28 10:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd27161f-0ae1-5786-8cb8-d345e1485a56 with identifier: JR02947
2026-01-28 10:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd27161f-0ae1-5786-8cb8-d345e1485a56 with identifier: JR02947
2026-01-28 10:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd27161f-0ae1-5786-8cb8-d345e1485a56 with identifier: JR02947 to the API
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR02947>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:43:06Z',
 'fuel_type': 'petrol',
 'id': 'dd27161f-0ae1-5786-8cb8-d345e1485a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR02947',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 93834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Night Eagle FWD',
 'transmission': 'automatic',
 'trim': 'Night Eagle FWD',
 'year': 2023}
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02947%27 HTTP/1.1" 200 None
2026-01-28 10:08:01 [auto1.it] INFO: Saving data for JR02947: {'auction_closing_time': 1769704986.0, 'created_time': 1767988955.630921, 'last_price_update_time': 1769594881.627282}
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR02947') HTTP/1.1" 204 0
2026-01-28 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE78786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX41967> (referer: https://www.auto1.com/v1/car-details-view/XX41967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC57699> (referer: https://www.auto1.com/v1/car-details-view/SC57699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee175bf6-3693-5f53-be25-1832f0ac84c8 with identifier: XX41967
2026-01-28 10:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee175bf6-3693-5f53-be25-1832f0ac84c8 with scrape type 1
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ee175bf6-3693-5f53-be25-1832f0ac84c8
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_9098ce55c4d88ccfec0e4e2acd7a4571.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9098ce55c4d88ccfec0e4e2acd7a4571.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_bdf4b0c0be2972ea965cfb220b7bf2e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_bdf4b0c0be2972ea965cfb220b7bf2e8.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_fa3beb57c691fc76db66d12cc56db835.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fa3beb57c691fc76db66d12cc56db835.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_daa9b1bb7b5af081199a156f6b31901e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_daa9b1bb7b5af081199a156f6b31901e.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_3f48f04da8d5e62c1783ef6fcb834806.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_3f48f04da8d5e62c1783ef6fcb834806.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_76fefcd7451a3f29f76facea9cdb7b93.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_76fefcd7451a3f29f76facea9cdb7b93.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_974112a8dd40500911259d92391cc91d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_974112a8dd40500911259d92391cc91d.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_35f0e68fcc5b257d30ff82f1691069c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_35f0e68fcc5b257d30ff82f1691069c5.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_b26724a4ca9e396d0722870e3aa01403.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_b26724a4ca9e396d0722870e3aa01403.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_e686f3e20dea852582c8b9c606c15657.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e686f3e20dea852582c8b9c606c15657.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_4d324eb4924986a328049bedc27f538d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_4d324eb4924986a328049bedc27f538d.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_fd526cecd1b6391fa3fa33d8a0ab9ae7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fd526cecd1b6391fa3fa33d8a0ab9ae7.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_e1620166d805eee46b7e230d3d90bd9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e1620166d805eee46b7e230d3d90bd9e.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_9d9997407e312247df2828718ac3620d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9d9997407e312247df2828718ac3620d.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_050a79937a93712c8473f0b877435dbf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_050a79937a93712c8473f0b877435dbf.jpg already downloaded
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F69%252F8869f60dadf0e8310fa2c7a3b7934747%252Fpa%252FXX41967_7f7adecd4ac7b5a0142598a0fd43be38.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_7f7adecd4ac7b5a0142598a0fd43be38.jpg already downloaded
2026-01-28 10:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee175bf6-3693-5f53-be25-1832f0ac84c8, identifier: XX41967
2026-01-28 10:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee175bf6-3693-5f53-be25-1832f0ac84c8 with identifier: XX41967
2026-01-28 10:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee175bf6-3693-5f53-be25-1832f0ac84c8 with identifier: XX41967
2026-01-28 10:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee175bf6-3693-5f53-be25-1832f0ac84c8 with identifier: XX41967 to the API
2026-01-28 10:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XX41967>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:28:26Z',
 'fuel_type': 'gas',
 'id': 'ee175bf6-3693-5f53-be25-1832f0ac84c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX41967',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 101510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9098ce55c4d88ccfec0e4e2acd7a4571.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_bdf4b0c0be2972ea965cfb220b7bf2e8.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fa3beb57c691fc76db66d12cc56db835.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_daa9b1bb7b5af081199a156f6b31901e.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_3f48f04da8d5e62c1783ef6fcb834806.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_76fefcd7451a3f29f76facea9cdb7b93.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_974112a8dd40500911259d92391cc91d.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_35f0e68fcc5b257d30ff82f1691069c5.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_b26724a4ca9e396d0722870e3aa01403.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e686f3e20dea852582c8b9c606c15657.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_4d324eb4924986a328049bedc27f538d.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fd526cecd1b6391fa3fa33d8a0ab9ae7.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e1620166d805eee46b7e230d3d90bd9e.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9d9997407e312247df2828718ac3620d.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_050a79937a93712c8473f0b877435dbf.jpg',
                'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_7f7adecd4ac7b5a0142598a0fd43be38.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9098ce55c4d88ccfec0e4e2acd7a4571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_bdf4b0c0be2972ea965cfb220b7bf2e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fa3beb57c691fc76db66d12cc56db835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_daa9b1bb7b5af081199a156f6b31901e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_3f48f04da8d5e62c1783ef6fcb834806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_76fefcd7451a3f29f76facea9cdb7b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_974112a8dd40500911259d92391cc91d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2049013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_35f0e68fcc5b257d30ff82f1691069c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_b26724a4ca9e396d0722870e3aa01403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e686f3e20dea852582c8b9c606c15657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_4d324eb4924986a328049bedc27f538d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_fd526cecd1b6391fa3fa33d8a0ab9ae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_e1620166d805eee46b7e230d3d90bd9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_9d9997407e312247df2828718ac3620d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_050a79937a93712c8473f0b877435dbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee175bf6-3693-5f53-be25-1832f0ac84c8/ee175bf6-3693-5f53-be25-1832f0ac84c8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/69/8869f60dadf0e8310fa2c7a3b7934747/pa/XX41967_7f7adecd4ac7b5a0142598a0fd43be38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX41967%27 HTTP/1.1" 200 None
2026-01-28 10:08:04 [auto1.it] INFO: Saving data for XX41967: {'auction_closing_time': 1769704106.0, 'created_time': 1769594884.185309, 'last_price_update_time': 1769594884.185319}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX41967') HTTP/1.1" 204 0
2026-01-28 10:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ94912> (referer: https://www.auto1.com/v1/car-details-view/VJ94912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-01-28 10:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f88a89-9cb9-5fee-a428-873f9296b02d with scrape type 2
2026-01-28 10:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f88a89-9cb9-5fee-a428-873f9296b02d with scrape type 2
2026-01-28 10:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9f88a89-9cb9-5fee-a428-873f9296b02d, identifier: SC57699
2026-01-28 10:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-01-28 10:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-01-28 10:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169130 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169130
2026-01-28 10:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d9f88a89-9cb9-5fee-a428-873f9296b02d spider: auto1.it
2026-01-28 10:08:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d9f88a89-9cb9-5fee-a428-873f9296b02d due to rule: high_mileage_for_country.json, error: 169130 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169130
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:48:17Z',
 'fuel_type': 'gas',
 'id': 'd9f88a89-9cb9-5fee-a428-873f9296b02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC57699',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'DR',
 'model': 'DR 4.0',
 'odometer': 169130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 4.0 1.5 LPG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-01-28 10:08:04 [auto1.it] INFO: Saving data for SC57699: {'auction_closing_time': 1769705297.0, 'created_time': 1768816856.580095, 'last_price_update_time': 1769594884.522539}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC57699') HTTP/1.1" 204 0
2026-01-28 10:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-01-28 10:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00ced43-e514-5699-b1eb-91afb6ade84c with scrape type 2
2026-01-28 10:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d00ced43-e514-5699-b1eb-91afb6ade84c with scrape type 2
2026-01-28 10:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d00ced43-e514-5699-b1eb-91afb6ade84c, identifier: VJ94912
2026-01-28 10:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-01-28 10:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912
2026-01-28 10:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d00ced43-e514-5699-b1eb-91afb6ade84c with identifier: VJ94912 to the API
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ94912>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 309,
 'expiration_date': '2026-01-29T16:03:59Z',
 'fuel_type': 'hybrid',
 'id': 'd00ced43-e514-5699-b1eb-91afb6ade84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ94912',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 106134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2020}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-01-28 10:08:04 [auto1.it] INFO: Saving data for VJ94912: {'auction_closing_time': 1769702639.0, 'created_time': 1767859296.511365, 'last_price_update_time': 1769594884.953323}
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ94912') HTTP/1.1" 204 0
2026-01-28 10:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_880aa9b133f5824395533a7d687c9ea5.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee32b250>
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_880aa9b133f5824395533a7d687c9ea5.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_880aa9b133f5824395533a7d687c9ea5.jpg saved to cache
2026-01-28 10:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE21788> (referer: https://www.auto1.com/v1/car-details-view/EE21788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31dd6919-4523-5938-87ba-15d0b59adb6b with identifier: EE21788
2026-01-28 10:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31dd6919-4523-5938-87ba-15d0b59adb6b with scrape type 2
2026-01-28 10:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31dd6919-4523-5938-87ba-15d0b59adb6b with scrape type 2
2026-01-28 10:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 31dd6919-4523-5938-87ba-15d0b59adb6b, identifier: EE21788
2026-01-28 10:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 31dd6919-4523-5938-87ba-15d0b59adb6b with identifier: EE21788
2026-01-28 10:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 31dd6919-4523-5938-87ba-15d0b59adb6b with identifier: EE21788
2026-01-28 10:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163924 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163924
2026-01-28 10:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 31dd6919-4523-5938-87ba-15d0b59adb6b spider: auto1.it
2026-01-28 10:08:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 31dd6919-4523-5938-87ba-15d0b59adb6b due to rule: high_mileage_for_country.json, error: 163924 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163924
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:05:20Z',
 'fuel_type': 'petrol',
 'id': '31dd6919-4523-5938-87ba-15d0b59adb6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE21788',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 163924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xperience',
 'transmission': 'automatic',
 'trim': 'Xperience',
 'year': 2021}
2026-01-28 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE21788%27 HTTP/1.1" 200 None
2026-01-28 10:08:06 [auto1.it] INFO: Saving data for EE21788: {'auction_closing_time': 1769702720.0, 'created_time': 1769198995.341065, 'last_price_update_time': 1769594886.836831}
2026-01-28 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE21788') HTTP/1.1" 204 0
2026-01-28 10:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4ea3110>
2026-01-28 10:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg saved to cache
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4f3bd49bc3248ce8eb208476997dadce.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee22a010>
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_4f3bd49bc3248ce8eb208476997dadce.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4f3bd49bc3248ce8eb208476997dadce.jpg saved to cache
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3d5a10>
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg saved to cache
2026-01-28 10:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee28e810>
2026-01-28 10:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg saved to cache
2026-01-28 10:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX31036> (referer: https://www.auto1.com/v1/car-details-view/PX31036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ec8726-0174-57f0-a943-1ad5001e8532 with identifier: PX31036
2026-01-28 10:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ec8726-0174-57f0-a943-1ad5001e8532 with scrape type 2
2026-01-28 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ec8726-0174-57f0-a943-1ad5001e8532 with scrape type 2
2026-01-28 10:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5ec8726-0174-57f0-a943-1ad5001e8532, identifier: PX31036
2026-01-28 10:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5ec8726-0174-57f0-a943-1ad5001e8532 with identifier: PX31036
2026-01-28 10:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5ec8726-0174-57f0-a943-1ad5001e8532 with identifier: PX31036
2026-01-28 10:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5ec8726-0174-57f0-a943-1ad5001e8532 with identifier: PX31036 to the API
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX31036>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-28T16:22:47Z',
 'fuel_type': 'petrol',
 'id': 'f5ec8726-0174-57f0-a943-1ad5001e8532',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX31036',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 63495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2021}
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX31036%27 HTTP/1.1" 200 None
2026-01-28 10:08:09 [auto1.it] INFO: Saving data for PX31036: {'auction_closing_time': 1769617367.0, 'created_time': 1769112188.263557, 'last_price_update_time': 1769594889.452014}
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX31036') HTTP/1.1" 204 0
2026-01-28 10:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF21484> (referer: https://www.auto1.com/v1/car-details-view/VF21484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5e8290>
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg saved to cache
2026-01-28 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4e80e0-1d74-5769-a624-d83d4b49e162 with identifier: VF21484
2026-01-28 10:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4e80e0-1d74-5769-a624-d83d4b49e162 with scrape type 2
2026-01-28 10:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b4e80e0-1d74-5769-a624-d83d4b49e162 with scrape type 2
2026-01-28 10:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b4e80e0-1d74-5769-a624-d83d4b49e162, identifier: VF21484
2026-01-28 10:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b4e80e0-1d74-5769-a624-d83d4b49e162 with identifier: VF21484
2026-01-28 10:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b4e80e0-1d74-5769-a624-d83d4b49e162 with identifier: VF21484
2026-01-28 10:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b4e80e0-1d74-5769-a624-d83d4b49e162 with identifier: VF21484 to the API
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF21484>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:52:07Z',
 'fuel_type': 'diesel',
 'id': '6b4e80e0-1d74-5769-a624-d83d4b49e162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF21484',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 31932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Lusso Ti',
 'transmission': 'manual',
 'trim': 'Lusso Ti',
 'year': 2020}
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF21484%27 HTTP/1.1" 200 None
2026-01-28 10:08:10 [auto1.it] INFO: Saving data for VF21484: {'auction_closing_time': 1769705527.0, 'created_time': 1767297686.764725, 'last_price_update_time': 1769594890.089871}
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF21484') HTTP/1.1" 204 0
2026-01-28 10:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5f86195c5c9453f3676e10293b4c956e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3b6dd0>
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg saved to cache
2026-01-28 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe79d0>
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_5f86195c5c9453f3676e10293b4c956e.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5f86195c5c9453f3676e10293b4c956e.jpg saved to cache
2026-01-28 10:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_954b90121b8ea5fc389d02d5194b98f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee577c90>
2026-01-28 10:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_954b90121b8ea5fc389d02d5194b98f2.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_954b90121b8ea5fc389d02d5194b98f2.jpg saved to cache
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK96429> (referer: https://www.auto1.com/v1/car-details-view/WK96429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a649cad-309b-50b2-9c69-98cb76f93be1 with identifier: WK96429
2026-01-28 10:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a649cad-309b-50b2-9c69-98cb76f93be1 with scrape type 1
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 9a649cad-309b-50b2-9c69-98cb76f93be1
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_4e18028622847f5d7afecf9bb94077dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_4e18028622847f5d7afecf9bb94077dc.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_018f92df3bff7908f28edf607252d78a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_018f92df3bff7908f28edf607252d78a.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_408d0d400077d74c4c562a93ca252ebc.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_408d0d400077d74c4c562a93ca252ebc.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_24b9b5629e7c9f9d160c54205fe813db.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_24b9b5629e7c9f9d160c54205fe813db.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_8f979fa55d4a83541112d45fcd98bf61.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_8f979fa55d4a83541112d45fcd98bf61.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_e7dd7c01c3f34e97668055a5f9b522ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7dd7c01c3f34e97668055a5f9b522ce.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_2daa3045ad8faa29ec23c41340c8e320.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_2daa3045ad8faa29ec23c41340c8e320.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_239e34cf90ce043a62b6f3e1060f88af.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_239e34cf90ce043a62b6f3e1060f88af.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_e7c431fda62a411ca344c2091c68cd07.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7c431fda62a411ca344c2091c68cd07.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_ad0575fbd0796e1c9ee4d6450a3d317a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_ad0575fbd0796e1c9ee4d6450a3d317a.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_9e85844d4bcc0c9af1bb02e3b53d7feb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_9e85844d4bcc0c9af1bb02e3b53d7feb.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_e43c7a44fbef46f33a8e6cb89b6d1c85.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e43c7a44fbef46f33a8e6cb89b6d1c85.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_d807c7ee065dd086b6fb1ba13c38314b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_d807c7ee065dd086b6fb1ba13c38314b.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_0f6c9e4e21932c3124b0e44061e6ed99.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_0f6c9e4e21932c3124b0e44061e6ed99.jpg already downloaded
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd3%252Fedd328bbdbe43f80bec65b0f11e6490a%252Fpa%252FWK96429_18336e5a650e59e6fdd6a6fed02d2470.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_18336e5a650e59e6fdd6a6fed02d2470.jpg already downloaded
2026-01-28 10:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a649cad-309b-50b2-9c69-98cb76f93be1, identifier: WK96429
2026-01-28 10:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a649cad-309b-50b2-9c69-98cb76f93be1 with identifier: WK96429
2026-01-28 10:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a649cad-309b-50b2-9c69-98cb76f93be1 with identifier: WK96429
2026-01-28 10:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a649cad-309b-50b2-9c69-98cb76f93be1 with identifier: WK96429 to the API
2026-01-28 10:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WK96429>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 207,
 'expiration_date': '2026-01-29T16:09:44Z',
 'fuel_type': 'petrol',
 'id': '9a649cad-309b-50b2-9c69-98cb76f93be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK96429',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 36624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_4e18028622847f5d7afecf9bb94077dc.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_018f92df3bff7908f28edf607252d78a.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_408d0d400077d74c4c562a93ca252ebc.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_24b9b5629e7c9f9d160c54205fe813db.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_8f979fa55d4a83541112d45fcd98bf61.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7dd7c01c3f34e97668055a5f9b522ce.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_2daa3045ad8faa29ec23c41340c8e320.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_239e34cf90ce043a62b6f3e1060f88af.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7c431fda62a411ca344c2091c68cd07.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_ad0575fbd0796e1c9ee4d6450a3d317a.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_9e85844d4bcc0c9af1bb02e3b53d7feb.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e43c7a44fbef46f33a8e6cb89b6d1c85.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_d807c7ee065dd086b6fb1ba13c38314b.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_0f6c9e4e21932c3124b0e44061e6ed99.jpg',
                'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_18336e5a650e59e6fdd6a6fed02d2470.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_4e18028622847f5d7afecf9bb94077dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_018f92df3bff7908f28edf607252d78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_408d0d400077d74c4c562a93ca252ebc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_24b9b5629e7c9f9d160c54205fe813db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_8f979fa55d4a83541112d45fcd98bf61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7dd7c01c3f34e97668055a5f9b522ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_2daa3045ad8faa29ec23c41340c8e320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_239e34cf90ce043a62b6f3e1060f88af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e7c431fda62a411ca344c2091c68cd07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_ad0575fbd0796e1c9ee4d6450a3d317a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_9e85844d4bcc0c9af1bb02e3b53d7feb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_e43c7a44fbef46f33a8e6cb89b6d1c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_d807c7ee065dd086b6fb1ba13c38314b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_0f6c9e4e21932c3124b0e44061e6ed99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a649cad-309b-50b2-9c69-98cb76f93be1/9a649cad-309b-50b2-9c69-98cb76f93be1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d3/edd328bbdbe43f80bec65b0f11e6490a/pa/WK96429_18336e5a650e59e6fdd6a6fed02d2470.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK96429%27 HTTP/1.1" 200 None
2026-01-28 10:08:12 [auto1.it] INFO: Saving data for WK96429: {'auction_closing_time': 1769702984.0, 'created_time': 1769594892.120207, 'last_price_update_time': 1769594892.120218}
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK96429') HTTP/1.1" 204 0
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee53b250>
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg saved to cache
2026-01-28 10:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee34d7d0>
2026-01-28 10:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg saved to cache
2026-01-28 10:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.353(s), this was the 1st time calling it.
2026-01-28 10:08:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.0870096311468105 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:08:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.656(s), this was the 1st time calling it.
2026-01-28 10:08:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.140878023660218 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU84711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_da2a99ad12002066244758fa03d99a5e.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bf74f8355a34a5449f0d657fb4fba117.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefe5d50>
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_da2a99ad12002066244758fa03d99a5e.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_da2a99ad12002066244758fa03d99a5e.jpg saved to cache
2026-01-28 10:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee53b910>
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_4.jpg HTTP/1.1" 201 0
2026-01-28 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_bf74f8355a34a5449f0d657fb4fba117.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bf74f8355a34a5449f0d657fb4fba117.jpg saved to cache
2026-01-28 10:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:08:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.309(s), this was the 1st time calling it.
2026-01-28 10:08:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.165986829972237 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:08:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.955(s), this was the 1st time calling it.
2026-01-28 10:08:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.583401283156499 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS53941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_16344e92a0d248807bb358dc8dee761c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:51\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef83790>
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_12.jpg HTTP/1.1" 201 0
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_16344e92a0d248807bb358dc8dee761c.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_16344e92a0d248807bb358dc8dee761c.jpg saved to cache
2026-01-28 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:27 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:08:27 [auto1.it] INFO: Found listing with ID: VJ15717
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ15717%27 HTTP/1.1" 200 None
2026-01-28 10:08:27 [auto1.it] INFO: Scrape type for VJ15717: 0
2026-01-28 10:08:27 [auto1.it] INFO: Found listing with ID: KW71256
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW71256%27 HTTP/1.1" 200 None
2026-01-28 10:08:27 [auto1.it] INFO: Scrape type for KW71256: 0
2026-01-28 10:08:27 [auto1.it] INFO: Found listing with ID: CL92988
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-28 10:08:27 [auto1.it] INFO: Scrape type for CL92988: 0
2026-01-28 10:08:27 [auto1.it] INFO: Found listing with ID: BD40988
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD40988%27 HTTP/1.1" 200 None
2026-01-28 10:08:27 [auto1.it] INFO: Scrape type for BD40988: 0
2026-01-28 10:08:27 [auto1.it] INFO: Found listing with ID: EF33407
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF33407%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for EF33407: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: NF51505
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF51505%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for NF51505: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: XY44417
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY44417%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for XY44417: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: YH86928
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH86928%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for YH86928: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: WH29835
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH29835%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for WH29835: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: NN32149
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN32149%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for NN32149: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: VH97733
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for VH97733: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: TL58155
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for TL58155: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: YE37664
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE37664%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for YE37664: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: SS94947
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for SS94947: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: SC16084
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC16084%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for SC16084: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: CA13828
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA13828%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for CA13828: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: HA56454
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA56454%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for HA56454: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: ZR47536
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR47536%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for ZR47536: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: ZN59549
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for ZN59549: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: JB16997
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB16997%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for JB16997: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: FU18669
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU18669%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for FU18669: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: DA91703
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA91703%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for DA91703: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: SB20175
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for SB20175: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: DZ26704
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ26704%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for DZ26704: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: LZ51611
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ51611%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for LZ51611: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: UL25385
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for UL25385: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: XR21079
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR21079%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for XR21079: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: SX45481
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX45481%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for SX45481: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: MB93346
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB93346%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for MB93346: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: FD40638
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD40638%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for FD40638: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: UW70389
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW70389%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for UW70389: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: UB21485
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB21485%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for UB21485: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: JY28433
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY28433%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for JY28433: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: ZW29655
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW29655%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for ZW29655: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: WB03743
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB03743%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for WB03743: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: MG41952
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for MG41952: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: EA43401
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA43401%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for EA43401: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: LZ25760
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for LZ25760: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: EE79301
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE79301%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for EE79301: 0
2026-01-28 10:08:28 [auto1.it] INFO: Found listing with ID: DT68594
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT68594%27 HTTP/1.1" 200 None
2026-01-28 10:08:28 [auto1.it] INFO: Scrape type for DT68594: 0
2026-01-28 10:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE78786> (referer: https://www.auto1.com/v1/car-details-view/AE78786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d538cd-ff73-5968-9f1e-017d09d5fea9 with identifier: AE78786
2026-01-28 10:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96d538cd-ff73-5968-9f1e-017d09d5fea9 with scrape type 2
2026-01-28 10:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96d538cd-ff73-5968-9f1e-017d09d5fea9 with scrape type 2
2026-01-28 10:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96d538cd-ff73-5968-9f1e-017d09d5fea9, identifier: AE78786
2026-01-28 10:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96d538cd-ff73-5968-9f1e-017d09d5fea9 with identifier: AE78786
2026-01-28 10:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96d538cd-ff73-5968-9f1e-017d09d5fea9 with identifier: AE78786
2026-01-28 10:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96d538cd-ff73-5968-9f1e-017d09d5fea9 with identifier: AE78786 to the API
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE78786>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:19:59Z',
 'fuel_type': 'hybrid',
 'id': '96d538cd-ff73-5968-9f1e-017d09d5fea9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE78786',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'BMW',
 'model': '3er',
 'odometer': 8092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE78786%27 HTTP/1.1" 200 None
2026-01-28 10:08:31 [auto1.it] INFO: Saving data for AE78786: {'auction_closing_time': 1769703599.0, 'created_time': 1768420874.0645, 'last_price_update_time': 1769594911.845607}
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AE78786') HTTP/1.1" 204 0
2026-01-28 10:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR00110> (referer: https://www.auto1.com/v1/car-details-view/PR00110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU22727> (referer: https://www.auto1.com/v1/car-details-view/SU22727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with identifier: PR00110
2026-01-28 10:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with scrape type 2
2026-01-28 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with scrape type 2
2026-01-28 10:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89, identifier: PR00110
2026-01-28 10:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with identifier: SU22727
2026-01-28 10:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with scrape type 2
2026-01-28 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with scrape type 2
2026-01-28 10:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bc43d43-59ac-591b-ae30-7580c0a1e9f5, identifier: SU22727
2026-01-28 10:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with identifier: PR00110
2026-01-28 10:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with identifier: PR00110
2026-01-28 10:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43a9d4c6-69ba-5aaf-8ff8-65696e85ce89 with identifier: PR00110 to the API
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR00110>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:39:28Z',
 'fuel_type': 'diesel',
 'id': '43a9d4c6-69ba-5aaf-8ff8-65696e85ce89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR00110',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 136797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR00110%27 HTTP/1.1" 200 None
2026-01-28 10:08:32 [auto1.it] INFO: Saving data for PR00110: {'auction_closing_time': 1769704768.0, 'created_time': 1768334526.013528, 'last_price_update_time': 1769594912.545038}
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR00110') HTTP/1.1" 204 0
2026-01-28 10:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with identifier: SU22727
2026-01-28 10:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with identifier: SU22727
2026-01-28 10:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bc43d43-59ac-591b-ae30-7580c0a1e9f5 with identifier: SU22727 to the API
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU22727>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:43:44Z',
 'fuel_type': 'petrol',
 'id': '4bc43d43-59ac-591b-ae30-7580c0a1e9f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU22727',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 46243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2021}
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU22727%27 HTTP/1.1" 200 None
2026-01-28 10:08:32 [auto1.it] INFO: Saving data for SU22727: {'auction_closing_time': 1769705024.0, 'created_time': 1769458534.204234, 'last_price_update_time': 1769594912.831276}
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU22727') HTTP/1.1" 204 0
2026-01-28 10:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef6cd50>
2026-01-28 10:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg saved to cache
2026-01-28 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK57785> (referer: https://www.auto1.com/v1/car-details-view/CK57785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_1d7236015f7ad263dce675db7bf41c59.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64796de2-bd26-5507-b0e1-be111bb3a296 with identifier: CK57785
2026-01-28 10:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64796de2-bd26-5507-b0e1-be111bb3a296 with scrape type 2
2026-01-28 10:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64796de2-bd26-5507-b0e1-be111bb3a296 with scrape type 2
2026-01-28 10:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64796de2-bd26-5507-b0e1-be111bb3a296, identifier: CK57785
2026-01-28 10:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64796de2-bd26-5507-b0e1-be111bb3a296 with identifier: CK57785
2026-01-28 10:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64796de2-bd26-5507-b0e1-be111bb3a296 with identifier: CK57785
2026-01-28 10:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64796de2-bd26-5507-b0e1-be111bb3a296 with identifier: CK57785 to the API
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK57785>
{'auction_title': '',
 'c_o_2_emission_value': 79,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 381,
 'expiration_date': '2026-01-29T16:00:56Z',
 'fuel_type': 'hybrid',
 'id': '64796de2-bd26-5507-b0e1-be111bb3a296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK57785',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 90154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2021}
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK57785%27 HTTP/1.1" 200 None
2026-01-28 10:08:33 [auto1.it] INFO: Saving data for CK57785: {'auction_closing_time': 1769702456.0, 'created_time': 1768853082.213856, 'last_price_update_time': 1769594913.646284}
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK57785') HTTP/1.1" 204 0
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:53\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee2f3790>
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_11.jpg HTTP/1.1" 201 0
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg saved to cache
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee9ec50>
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg saved to cache
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee49a650>
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_3.jpg HTTP/1.1" 201 0
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_1d7236015f7ad263dce675db7bf41c59.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_1d7236015f7ad263dce675db7bf41c59.jpg saved to cache
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC06007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU18673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK57569> (referer: https://www.auto1.com/v1/car-details-view/GK57569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ01264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE91264> (referer: https://www.auto1.com/v1/car-details-view/LE91264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with identifier: GK57569
2026-01-28 10:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with scrape type 2
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with scrape type 2
2026-01-28 10:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36eabbfc-3f7d-564e-b1f0-af8cf553f915, identifier: GK57569
2026-01-28 10:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ae9ad5-f9f6-5960-a88c-66137209f8a5 with identifier: LE91264
2026-01-28 10:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ae9ad5-f9f6-5960-a88c-66137209f8a5 with scrape type 2
2026-01-28 10:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ae9ad5-f9f6-5960-a88c-66137209f8a5 with scrape type 2
2026-01-28 10:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94ae9ad5-f9f6-5960-a88c-66137209f8a5, identifier: LE91264
2026-01-28 10:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with identifier: GK57569
2026-01-28 10:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with identifier: GK57569
2026-01-28 10:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36eabbfc-3f7d-564e-b1f0-af8cf553f915 with identifier: GK57569 to the API
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK57569>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-28T16:02:27Z',
 'fuel_type': 'petrol',
 'id': '36eabbfc-3f7d-564e-b1f0-af8cf553f915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK57569',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 112430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2019}
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK57569%27 HTTP/1.1" 200 None
2026-01-28 10:08:35 [auto1.it] INFO: Saving data for GK57569: {'auction_closing_time': 1769616147.0, 'created_time': 1769076144.63601, 'last_price_update_time': 1769594915.441615}
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK57569') HTTP/1.1" 204 0
2026-01-28 10:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94ae9ad5-f9f6-5960-a88c-66137209f8a5 with identifier: LE91264
2026-01-28 10:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94ae9ad5-f9f6-5960-a88c-66137209f8a5 with identifier: LE91264
2026-01-28 10:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 10:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 94ae9ad5-f9f6-5960-a88c-66137209f8a5 spider: auto1.it
2026-01-28 10:08:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 94ae9ad5-f9f6-5960-a88c-66137209f8a5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:29:56Z',
 'fuel_type': 'diesel',
 'id': '94ae9ad5-f9f6-5960-a88c-66137209f8a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91264',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 35279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-17',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid L1 Titanium',
 'transmission': 'manual',
 'trim': 'L1 Titanium',
 'year': 2022}
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE91264%27 HTTP/1.1" 200 None
2026-01-28 10:08:35 [auto1.it] INFO: Saving data for LE91264: {'auction_closing_time': 1769704196.0, 'created_time': 1768384954.684, 'last_price_update_time': 1769594915.692133}
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE91264') HTTP/1.1" 204 0
2026-01-28 10:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_e52d752c67d8b894944e8cbb176012a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:52\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee208c90>
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_10.jpg HTTP/1.1" 201 0
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg saved to cache
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefef6d0>
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg saved to cache
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefed890>
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg saved to cache
2026-01-28 10:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC79626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f4088850>
2026-01-28 10:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252Fa2%252Fdaa23bd738ca16e06a34b05e594d3c31%252Fpa%252FNC16771_e52d752c67d8b894944e8cbb176012a2.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_e52d752c67d8b894944e8cbb176012a2.jpg saved to cache
2026-01-28 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305
2026-01-28 10:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305, skipping ID generation
2026-01-28 10:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with scrape type 1
2026-01-28 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 from tracking dictionaries
2026-01-28 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 sending to next pipeline
2026-01-28 10:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305, identifier: NC16771
2026-01-28 10:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with identifier: NC16771
2026-01-28 10:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with identifier: NC16771
2026-01-28 10:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ddcc53e6-34ce-5e65-a8b2-ba3b18b34305 with identifier: NC16771 to the API
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_e52d752c67d8b894944e8cbb176012a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:21:27Z',
 'fuel_type': 'petrol',
 'id': 'ddcc53e6-34ce-5e65-a8b2-ba3b18b34305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC16771',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 28607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_d9f1944b14bdac568f17d23d0fce6dcd.jpg',
             'Width': 644},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_e52d752c67d8b894944e8cbb176012a2.jpg',
             'Width': 644},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_b2f066821c48c3114d2ec7c7a66ac280.jpg',
             'Width': 760},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e7f82d03b4a2229f1ae93f618b625cc.jpg',
             'Width': 683},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_da2a99ad12002066244758fa03d99a5e.jpg',
             'Width': 620},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_2a1cff93d94a1d8bdcc44d36be6d0991.jpg',
             'Width': 670},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5f86195c5c9453f3676e10293b4c956e.jpg',
             'Width': 612},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96822,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_20ca62dc9fedfb9054dfb8d40d6c6e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89881,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3a7bf903aa9071d7d97dde10a8b30b7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70336,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_3aa203fa15be3b758a3d75f0b4ad6e55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73378,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_0e2f2f2f3effaf7edd6b317b544b5a60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29082,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_79fa2f308e6a1438d451d63eba587ef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59907,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_5150efe471568a53124122a1960c853d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddcc53e6-34ce-5e65-a8b2-ba3b18b34305/ddcc53e6-34ce-5e65-a8b2-ba3b18b34305_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72863,
             'Height': 534,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/a2/daa23bd738ca16e06a34b05e594d3c31/pa/NC16771_436ad8cd0158068f0685f257255250de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC16771%27 HTTP/1.1" 200 None
2026-01-28 10:08:37 [auto1.it] INFO: Saving data for NC16771: {'auction_closing_time': 1769703687.0, 'created_time': 1769594917.647103, 'last_price_update_time': 1769594917.647116}
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC16771') HTTP/1.1" 204 0
2026-01-28 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS53941> (referer: https://www.auto1.com/v1/car-details-view/CS53941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE87836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV90862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d26deb9bbca6273333cd94fb31dda077.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f265d625-aa01-5158-b47a-1878f64ba745 with identifier: CS53941
2026-01-28 10:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f265d625-aa01-5158-b47a-1878f64ba745 with scrape type 2
2026-01-28 10:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f265d625-aa01-5158-b47a-1878f64ba745 with scrape type 2
2026-01-28 10:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f265d625-aa01-5158-b47a-1878f64ba745, identifier: CS53941
2026-01-28 10:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f265d625-aa01-5158-b47a-1878f64ba745 with identifier: CS53941
2026-01-28 10:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f265d625-aa01-5158-b47a-1878f64ba745 with identifier: CS53941
2026-01-28 10:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f265d625-aa01-5158-b47a-1878f64ba745 with identifier: CS53941 to the API
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CS53941>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-28T16:18:58Z',
 'fuel_type': 'diesel',
 'id': 'f265d625-aa01-5158-b47a-1878f64ba745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS53941',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 141251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS53941%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Saving data for CS53941: {'auction_closing_time': 1769617138.0, 'created_time': 1769112320.546504, 'last_price_update_time': 1769594918.233267}
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS53941') HTTP/1.1" 204 0
2026-01-28 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU84711> (referer: https://www.auto1.com/v1/car-details-view/JU84711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:51\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40d5410>
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_9.jpg HTTP/1.1" 201 0
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_d26deb9bbca6273333cd94fb31dda077.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d26deb9bbca6273333cd94fb31dda077.jpg saved to cache
2026-01-28 10:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:38 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: WW18844
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW18844%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for WW18844: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: UU67161
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU67161%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for UU67161: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: WU99342
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU99342%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for WU99342: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: NU65526
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU65526%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for NU65526: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: LR66661
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66661%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for LR66661: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: ZS49821
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS49821%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for ZS49821: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: DP28978
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP28978%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for DP28978: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: VB04552
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for VB04552: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: ZE08740
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE08740%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for ZE08740: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: DM01874
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM01874%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for DM01874: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: VG35623
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG35623%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for VG35623: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: TY85783
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY85783%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for TY85783: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: TD32917
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for TD32917: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: WM98740
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM98740%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for WM98740: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: HU59594
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU59594%27 HTTP/1.1" 200 None
2026-01-28 10:08:38 [auto1.it] INFO: Scrape type for HU59594: 0
2026-01-28 10:08:38 [auto1.it] INFO: Found listing with ID: XS62284
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS62284%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for XS62284: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: EY77758
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY77758%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for EY77758: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: WG74609
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG74609%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for WG74609: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: LB68878
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for LB68878: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: CU67286
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for CU67286: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: DG99374
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG99374%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for DG99374: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: BJ35088
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ35088%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for BJ35088: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: NL52745
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL52745%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for NL52745: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: UF85865
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF85865%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for UF85865: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: EU86944
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU86944%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for EU86944: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: TR30387
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR30387%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for TR30387: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: GM65360
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM65360%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for GM65360: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: ML60826
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for ML60826: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: EW00290
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW00290%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for EW00290: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: HS43886
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43886%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for HS43886: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: CZ27491
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ27491%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for CZ27491: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: XC50328
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for XC50328: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: JC26558
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC26558%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for JC26558: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: EH49514
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH49514%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for EH49514: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: LY98983
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY98983%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for LY98983: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: BJ54978
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ54978%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for BJ54978: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: MK54572
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK54572%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for MK54572: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: YY40771
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY40771%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for YY40771: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: BT06439
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for BT06439: 0
2026-01-28 10:08:39 [auto1.it] INFO: Found listing with ID: WA71595
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA71595%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Scrape type for WA71595: 0
2026-01-28 10:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 323f29cf-b252-5384-b769-c2a373734f84 with identifier: JU84711
2026-01-28 10:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 323f29cf-b252-5384-b769-c2a373734f84 with scrape type 2
2026-01-28 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 323f29cf-b252-5384-b769-c2a373734f84 with scrape type 2
2026-01-28 10:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 323f29cf-b252-5384-b769-c2a373734f84, identifier: JU84711
2026-01-28 10:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ41788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 323f29cf-b252-5384-b769-c2a373734f84 with identifier: JU84711
2026-01-28 10:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 323f29cf-b252-5384-b769-c2a373734f84 with identifier: JU84711
2026-01-28 10:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2026-01-28 10:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 323f29cf-b252-5384-b769-c2a373734f84 spider: auto1.it
2026-01-28 10:08:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 323f29cf-b252-5384-b769-c2a373734f84 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.3L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-28T16:39:16Z',
 'fuel_type': 'diesel',
 'id': '323f29cf-b252-5384-b769-c2a373734f84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU84711',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 75771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2018}
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU84711%27 HTTP/1.1" 200 None
2026-01-28 10:08:39 [auto1.it] INFO: Saving data for JU84711: {'auction_closing_time': 1769618356.0, 'created_time': 1769414472.151305, 'last_price_update_time': 1769594919.875946}
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU84711') HTTP/1.1" 204 0
2026-01-28 10:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_5a77c4a48c21c849694fba37c1ad672f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d224dfa9193a0451f36a8546720207d2.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_cb1a318d7826a16063e4b1e35305703f.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY86470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee23d3d0>
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_5a77c4a48c21c849694fba37c1ad672f.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_5a77c4a48c21c849694fba37c1ad672f.jpg saved to cache
2026-01-28 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM21779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ01264> (referer: https://www.auto1.com/v1/car-details-view/FZ01264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU18673> (referer: https://www.auto1.com/v1/car-details-view/ZU18673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:49\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee23cc10>
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_8.jpg HTTP/1.1" 201 0
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg saved to cache
2026-01-28 10:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:01:27 15:44:48\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-01-28 10:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40451d0>
2026-01-28 10:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_7.jpg HTTP/1.1" 201 0
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_d224dfa9193a0451f36a8546720207d2.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d224dfa9193a0451f36a8546720207d2.jpg saved to cache
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee34ff10>
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd4%252Fbfd4fdd01d22594053129c47e5cf0cb7%252Fpa%252FKF48878_cb1a318d7826a16063e4b1e35305703f.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_cb1a318d7826a16063e4b1e35305703f.jpg saved to cache
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7804af6-9699-5a6b-91ed-88bc86b7b245
2026-01-28 10:08:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7804af6-9699-5a6b-91ed-88bc86b7b245, skipping ID generation
2026-01-28 10:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7804af6-9699-5a6b-91ed-88bc86b7b245 with scrape type 1
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7804af6-9699-5a6b-91ed-88bc86b7b245 from tracking dictionaries
2026-01-28 10:08:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7804af6-9699-5a6b-91ed-88bc86b7b245 sending to next pipeline
2026-01-28 10:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7804af6-9699-5a6b-91ed-88bc86b7b245, identifier: KF48878
2026-01-28 10:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7804af6-9699-5a6b-91ed-88bc86b7b245 with identifier: KF48878
2026-01-28 10:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7804af6-9699-5a6b-91ed-88bc86b7b245 with identifier: KF48878
2026-01-28 10:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7804af6-9699-5a6b-91ed-88bc86b7b245 with identifier: KF48878 to the API
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_cb1a318d7826a16063e4b1e35305703f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:36:38Z',
 'fuel_type': 'diesel',
 'id': 'b7804af6-9699-5a6b-91ed-88bc86b7b245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF48878',
 'listing': 'auction',
 'location': 'IT, Pradamano (UD)',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 139305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3282367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_cb1a318d7826a16063e4b1e35305703f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3370725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_5a77c4a48c21c849694fba37c1ad672f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3268975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_ec6b6b5e1fabe10a1c3cab4399008f0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3122664,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_1d7236015f7ad263dce675db7bf41c59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3364086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bf74f8355a34a5449f0d657fb4fba117.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3368893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_8754a172a06ad64b0ff3d0d2879b73f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_954b90121b8ea5fc389d02d5194b98f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3289021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4afdf8fc5b0c0cc7355ad457dc368a05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3238096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_c138ca99f64c78ca9df517a9f05f80f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3345686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_4f3bd49bc3248ce8eb208476997dadce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_880aa9b133f5824395533a7d687c9ea5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835648,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_d807178ff24868bdc3090169fd742fb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_fa6b1be08a0d1a940f2edd07024319ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_bdd826e420fa38771171743a2d1b064c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7804af6-9699-5a6b-91ed-88bc86b7b245/b7804af6-9699-5a6b-91ed-88bc86b7b245_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d4/bfd4fdd01d22594053129c47e5cf0cb7/pa/KF48878_7a4d6d4dc91656afc7876361168bc620.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF48878%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [auto1.it] INFO: Saving data for KF48878: {'auction_closing_time': 1769704598.0, 'created_time': 1769594922.059831, 'last_price_update_time': 1769594922.059841}
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF48878') HTTP/1.1" 204 0
2026-01-28 10:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC06007> (referer: https://www.auto1.com/v1/car-details-view/FC06007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29097f83-bfc1-56d6-becc-cda6807c83e1 with identifier: FZ01264
2026-01-28 10:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29097f83-bfc1-56d6-becc-cda6807c83e1 with scrape type 1
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 29097f83-bfc1-56d6-becc-cda6807c83e1
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_7293ce7260b1d5a6eff5850c80a30e89.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7293ce7260b1d5a6eff5850c80a30e89.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_374a2e580618ed4df5a06cf39ef771eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_374a2e580618ed4df5a06cf39ef771eb.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_3dce1fae8a942e9e68913f536cf26b1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3dce1fae8a942e9e68913f536cf26b1c.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_fb312e28a465f71ed4180d1b5ab0c5ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_fb312e28a465f71ed4180d1b5ab0c5ae.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_92a04d665ea184f803e100e1960f9a10.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92a04d665ea184f803e100e1960f9a10.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_781c06e709d1fa2d312f6e9f0227f02a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_781c06e709d1fa2d312f6e9f0227f02a.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_afb95e941c82bc423b16000bd1f3f42c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_afb95e941c82bc423b16000bd1f3f42c.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_2144effe79d9846bd5a9506211768554.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_2144effe79d9846bd5a9506211768554.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_b7925c3aa8976481e628fe4db2d68189.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_b7925c3aa8976481e628fe4db2d68189.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_3b2f44cffc1dc444a4a0f94773a5ba94.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3b2f44cffc1dc444a4a0f94773a5ba94.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_cddcd606fdb5c1f769150fab9680d68d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_cddcd606fdb5c1f769150fab9680d68d.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_7a605b9de93211c798a295ba2b2d8f37.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7a605b9de93211c798a295ba2b2d8f37.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_813d3b9d809a408706674ce001fd190c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_813d3b9d809a408706674ce001fd190c.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_d18171b3d2fbe682111821ba91868832.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_d18171b3d2fbe682111821ba91868832.jpg already downloaded
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fce%252Ffacefdfb0ba48c6e9284eab59185e686%252Fpa%252FFZ01264_92e29e2f5c9522fcabed02ef80a62cc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92e29e2f5c9522fcabed02ef80a62cc5.jpg already downloaded
2026-01-28 10:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29097f83-bfc1-56d6-becc-cda6807c83e1, identifier: FZ01264
2026-01-28 10:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9a8903-766d-5e4e-bf81-bfd8960a8927 with identifier: ZU18673
2026-01-28 10:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9a8903-766d-5e4e-bf81-bfd8960a8927 with scrape type 2
2026-01-28 10:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9a8903-766d-5e4e-bf81-bfd8960a8927 with scrape type 2
2026-01-28 10:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf9a8903-766d-5e4e-bf81-bfd8960a8927, identifier: ZU18673
2026-01-28 10:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29097f83-bfc1-56d6-becc-cda6807c83e1 with identifier: FZ01264
2026-01-28 10:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29097f83-bfc1-56d6-becc-cda6807c83e1 with identifier: FZ01264
2026-01-28 10:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173887 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173887
2026-01-28 10:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29097f83-bfc1-56d6-becc-cda6807c83e1 spider: auto1.it
2026-01-28 10:08:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 29097f83-bfc1-56d6-becc-cda6807c83e1 due to rule: high_mileage_for_country.json, error: 173887 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173887
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:17:15Z',
 'fuel_type': 'diesel',
 'id': '29097f83-bfc1-56d6-becc-cda6807c83e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ01264',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 173887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7293ce7260b1d5a6eff5850c80a30e89.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_374a2e580618ed4df5a06cf39ef771eb.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3dce1fae8a942e9e68913f536cf26b1c.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_fb312e28a465f71ed4180d1b5ab0c5ae.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92a04d665ea184f803e100e1960f9a10.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_781c06e709d1fa2d312f6e9f0227f02a.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_afb95e941c82bc423b16000bd1f3f42c.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_2144effe79d9846bd5a9506211768554.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_b7925c3aa8976481e628fe4db2d68189.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3b2f44cffc1dc444a4a0f94773a5ba94.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_cddcd606fdb5c1f769150fab9680d68d.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7a605b9de93211c798a295ba2b2d8f37.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_813d3b9d809a408706674ce001fd190c.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_d18171b3d2fbe682111821ba91868832.jpg',
                'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92e29e2f5c9522fcabed02ef80a62cc5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7293ce7260b1d5a6eff5850c80a30e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_374a2e580618ed4df5a06cf39ef771eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3dce1fae8a942e9e68913f536cf26b1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_fb312e28a465f71ed4180d1b5ab0c5ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92a04d665ea184f803e100e1960f9a10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_781c06e709d1fa2d312f6e9f0227f02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_afb95e941c82bc423b16000bd1f3f42c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_2144effe79d9846bd5a9506211768554.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_b7925c3aa8976481e628fe4db2d68189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_3b2f44cffc1dc444a4a0f94773a5ba94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_cddcd606fdb5c1f769150fab9680d68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_7a605b9de93211c798a295ba2b2d8f37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_813d3b9d809a408706674ce001fd190c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_d18171b3d2fbe682111821ba91868832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29097f83-bfc1-56d6-becc-cda6807c83e1/29097f83-bfc1-56d6-becc-cda6807c83e1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/ce/facefdfb0ba48c6e9284eab59185e686/pa/FZ01264_92e29e2f5c9522fcabed02ef80a62cc5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman One D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ01264%27 HTTP/1.1" 200 None
2026-01-28 10:08:42 [auto1.it] INFO: Saving data for FZ01264: {'auction_closing_time': 1769703435.0, 'created_time': 1769594922.803958, 'last_price_update_time': 1769594922.803968}
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FZ01264') HTTP/1.1" 204 0
2026-01-28 10:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf9a8903-766d-5e4e-bf81-bfd8960a8927 with identifier: ZU18673
2026-01-28 10:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf9a8903-766d-5e4e-bf81-bfd8960a8927 with identifier: ZU18673
2026-01-28 10:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf9a8903-766d-5e4e-bf81-bfd8960a8927 with identifier: ZU18673 to the API
2026-01-28 10:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU18673>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:26:39Z',
 'fuel_type': 'petrol',
 'id': 'bf9a8903-766d-5e4e-bf81-bfd8960a8927',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU18673',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'MG',
 'model': '3',
 'odometer': 880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG 3 1.5 Turbo Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2025}
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU18673%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [auto1.it] INFO: Saving data for ZU18673: {'auction_closing_time': 1769703999.0, 'created_time': 1768420849.771249, 'last_price_update_time': 1769594923.441391}
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU18673') HTTP/1.1" 204 0
2026-01-28 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC79626> (referer: https://www.auto1.com/v1/car-details-view/ZC79626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e598d229-694d-548c-8024-90dd23d4ba19 with identifier: FC06007
2026-01-28 10:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e598d229-694d-548c-8024-90dd23d4ba19 with scrape type 1
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e598d229-694d-548c-8024-90dd23d4ba19
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_476eb7017796d5769d20d1183bee5515.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_476eb7017796d5769d20d1183bee5515.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_bf87e5d9cbb87c8766c2048ff3fe84bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_bf87e5d9cbb87c8766c2048ff3fe84bb.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_9f4d69b0a7c766214d98238872f8e13a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_9f4d69b0a7c766214d98238872f8e13a.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_0f8dbdc338f1d20aa57c2e1b8bd65a9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_0f8dbdc338f1d20aa57c2e1b8bd65a9e.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_1b287e82739b0eb17b770bf47e0ff79f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_1b287e82739b0eb17b770bf47e0ff79f.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_b70f6c85b83684ca37d1491775a67b8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_b70f6c85b83684ca37d1491775a67b8f.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_939d74c0014a314f5ab8926192b19c63.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_939d74c0014a314f5ab8926192b19c63.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_993b3fc35a666107bde3e9a838b310de.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_993b3fc35a666107bde3e9a838b310de.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_359f53ab829eb99ff6bf90400c8112a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_359f53ab829eb99ff6bf90400c8112a6.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_2deeffa8b71f62b5edf0175dd12e1ada.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_2deeffa8b71f62b5edf0175dd12e1ada.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_25df47946611ff3d932fa84ffee44247.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_25df47946611ff3d932fa84ffee44247.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_033f53d52edfd6c18b830491eb3eefab.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_033f53d52edfd6c18b830491eb3eefab.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_754717bef4f1674c4dd7e8023038bf62.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_754717bef4f1674c4dd7e8023038bf62.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_ce5d42434913cf26b17d43390151aafe.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_ce5d42434913cf26b17d43390151aafe.jpg already downloaded
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F98%252F5e98885e2829d54eaf59969c545a252b%252Fpa%252FFC06007_c4185880fda1b4beb71d4eced95d3717.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_c4185880fda1b4beb71d4eced95d3717.jpg already downloaded
2026-01-28 10:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e598d229-694d-548c-8024-90dd23d4ba19, identifier: FC06007
2026-01-28 10:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e598d229-694d-548c-8024-90dd23d4ba19 with identifier: FC06007
2026-01-28 10:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e598d229-694d-548c-8024-90dd23d4ba19 with identifier: FC06007
2026-01-28 10:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e598d229-694d-548c-8024-90dd23d4ba19 with identifier: FC06007 to the API
2026-01-28 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC06007>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:01:45Z',
 'fuel_type': 'petrol',
 'id': 'e598d229-694d-548c-8024-90dd23d4ba19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC06007',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 78259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_476eb7017796d5769d20d1183bee5515.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_bf87e5d9cbb87c8766c2048ff3fe84bb.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_9f4d69b0a7c766214d98238872f8e13a.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_0f8dbdc338f1d20aa57c2e1b8bd65a9e.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_1b287e82739b0eb17b770bf47e0ff79f.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_b70f6c85b83684ca37d1491775a67b8f.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_939d74c0014a314f5ab8926192b19c63.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_993b3fc35a666107bde3e9a838b310de.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_359f53ab829eb99ff6bf90400c8112a6.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_2deeffa8b71f62b5edf0175dd12e1ada.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_25df47946611ff3d932fa84ffee44247.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_033f53d52edfd6c18b830491eb3eefab.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_754717bef4f1674c4dd7e8023038bf62.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_ce5d42434913cf26b17d43390151aafe.jpg',
                'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_c4185880fda1b4beb71d4eced95d3717.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_476eb7017796d5769d20d1183bee5515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3435659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_bf87e5d9cbb87c8766c2048ff3fe84bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3318441,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_9f4d69b0a7c766214d98238872f8e13a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_0f8dbdc338f1d20aa57c2e1b8bd65a9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_1b287e82739b0eb17b770bf47e0ff79f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_b70f6c85b83684ca37d1491775a67b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_939d74c0014a314f5ab8926192b19c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_993b3fc35a666107bde3e9a838b310de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_359f53ab829eb99ff6bf90400c8112a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_2deeffa8b71f62b5edf0175dd12e1ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_25df47946611ff3d932fa84ffee44247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_033f53d52edfd6c18b830491eb3eefab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_754717bef4f1674c4dd7e8023038bf62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_ce5d42434913cf26b17d43390151aafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e598d229-694d-548c-8024-90dd23d4ba19/e598d229-694d-548c-8024-90dd23d4ba19_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/98/5e98885e2829d54eaf59969c545a252b/pa/FC06007_c4185880fda1b4beb71d4eced95d3717.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2020}
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC06007%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Saving data for FC06007: {'auction_closing_time': 1769702505.0, 'created_time': 1769594924.265587, 'last_price_update_time': 1769594924.265602}
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC06007') HTTP/1.1" 204 0
2026-01-28 10:08:44 [scrapy.extensions.logstats] INFO: Crawled 290 pages (at 41 pages/min), scraped 97 items (at 18 items/min)
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH61995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU90270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX41377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with identifier: ZC79626
2026-01-28 10:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with scrape type 2
2026-01-28 10:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with scrape type 2
2026-01-28 10:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 642e204c-d4ae-5dd4-94a0-561fadcf9d63, identifier: ZC79626
2026-01-28 10:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with identifier: ZC79626
2026-01-28 10:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with identifier: ZC79626
2026-01-28 10:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 642e204c-d4ae-5dd4-94a0-561fadcf9d63 with identifier: ZC79626 to the API
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC79626>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:55:02Z',
 'fuel_type': 'hybrid',
 'id': '642e204c-d4ae-5dd4-94a0-561fadcf9d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC79626',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 17509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2022}
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC79626%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Saving data for ZC79626: {'auction_closing_time': 1769705702.0, 'created_time': 1768853229.535683, 'last_price_update_time': 1769594924.842265}
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC79626') HTTP/1.1" 204 0
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b99afe0f82c8e5529e46c1b40690c473.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV90862> (referer: https://www.auto1.com/v1/car-details-view/MV90862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:44 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: FT86640
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Scrape type for FT86640: 0
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: SP36812
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Scrape type for SP36812: 0
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: RN24419
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Scrape type for RN24419: 0
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: VL59630
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL59630%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Scrape type for VL59630: 0
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: AW96093
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW96093%27 HTTP/1.1" 200 None
2026-01-28 10:08:44 [auto1.it] INFO: Scrape type for AW96093: 0
2026-01-28 10:08:44 [auto1.it] INFO: Found listing with ID: DE55553
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for DE55553: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: NR38065
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for NR38065: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: FM42307
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM42307%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for FM42307: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: VW59498
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW59498%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for VW59498: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: YC09499
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for YC09499: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: ZL05088
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for ZL05088: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: LX56399
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX56399%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for LX56399: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: YK92644
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK92644%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for YK92644: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: BG40682
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG40682%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for BG40682: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: WW83392
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for WW83392: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: MU47975
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for MU47975: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: CD43232
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for CD43232: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: HH00112
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH00112%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for HH00112: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: CN82812
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for CN82812: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: TZ53924
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ53924%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for TZ53924: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: KK64864
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for KK64864: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: DA21697
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for DA21697: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: TA01663
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA01663%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for TA01663: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: ZT50467
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT50467%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for ZT50467: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: ML31278
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML31278%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for ML31278: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: FN81119
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN81119%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for FN81119: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: LX99964
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX99964%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for LX99964: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: TB52041
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for TB52041: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: CV26562
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for CV26562: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: NG74900
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for NG74900: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: BL68593
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL68593%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for BL68593: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: EL05291
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for EL05291: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: ER23640
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER23640%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for ER23640: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: XE90454
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE90454%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for XE90454: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: LW49157
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW49157%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for LW49157: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: DK89708
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK89708%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for DK89708: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: JE72665
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for JE72665: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: FU00657
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for FU00657: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: JP83347
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for JP83347: 0
2026-01-28 10:08:45 [auto1.it] INFO: Found listing with ID: SG87196
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-28 10:08:45 [auto1.it] INFO: Scrape type for SG87196: 0
2026-01-28 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_929970e603c7d8b30b6ba7321577973b.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9941ad7129c03610d1a7db53be4ac397.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7abe348fa463b697890cf983f408fb08.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee13790>
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_2.jpg HTTP/1.1" 201 0
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_b99afe0f82c8e5529e46c1b40690c473.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b99afe0f82c8e5529e46c1b40690c473.jpg saved to cache
2026-01-28 10:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee3482d0>
2026-01-28 10:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg saved to cache
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee0c1d0>
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_5.jpg HTTP/1.1" 201 0
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg saved to cache
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eeece910>
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_6.jpg HTTP/1.1" 201 0
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5d%252F225d4a4d191071c2a8cf042bdab6f931%252Fpa%252FLN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg saved to cache
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af58132-80ec-5e1b-a7fb-15b31459ca87
2026-01-28 10:08:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af58132-80ec-5e1b-a7fb-15b31459ca87, skipping ID generation
2026-01-28 10:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af58132-80ec-5e1b-a7fb-15b31459ca87 with scrape type 1
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5af58132-80ec-5e1b-a7fb-15b31459ca87 from tracking dictionaries
2026-01-28 10:08:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af58132-80ec-5e1b-a7fb-15b31459ca87 sending to next pipeline
2026-01-28 10:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5af58132-80ec-5e1b-a7fb-15b31459ca87, identifier: LN71462
2026-01-28 10:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 974f465d-f595-532b-8c49-1161ef940ef4 with identifier: MV90862
2026-01-28 10:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 974f465d-f595-532b-8c49-1161ef940ef4 with scrape type 2
2026-01-28 10:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 974f465d-f595-532b-8c49-1161ef940ef4 with scrape type 2
2026-01-28 10:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 974f465d-f595-532b-8c49-1161ef940ef4, identifier: MV90862
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5af58132-80ec-5e1b-a7fb-15b31459ca87 with identifier: LN71462
2026-01-28 10:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5af58132-80ec-5e1b-a7fb-15b31459ca87 with identifier: LN71462
2026-01-28 10:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
2026-01-28 10:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5af58132-80ec-5e1b-a7fb-15b31459ca87 spider: auto1.it
2026-01-28 10:08:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 5af58132-80ec-5e1b-a7fb-15b31459ca87 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 235,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:04:35Z',
 'fuel_type': 'diesel',
 'id': '5af58132-80ec-5e1b-a7fb-15b31459ca87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN71462',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 82600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629819,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_3a6ad08277c38260ee36ceb619b05717.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629819,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_67aeb88a7e117bd1fb0c7b2b43583c1c.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568903,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b99afe0f82c8e5529e46c1b40690c473.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509259,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_b1d2824fa12db81c32ec381fd708e863.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557889,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_c126b9c71bbd99ecd9ed361233117b0b.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610482,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_dbbba4f5a91792a471dce9eaeb83afa8.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637550,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_915d2278ac5bc25ec10f40cd69d791cf.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1621710,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d224dfa9193a0451f36a8546720207d2.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1378188,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_f2aa5ca1b8e5e157266672ccfea8d1bc.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1458886,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_d26deb9bbca6273333cd94fb31dda077.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1736066,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ca0fe70b7bb0d3b21f3055e6b67c40e2.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1663915,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_ba515b3091a64f22ed81dab1c3d309ab.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af58132-80ec-5e1b-a7fb-15b31459ca87/5af58132-80ec-5e1b-a7fb-15b31459ca87_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1458886,
             'Height': 1000,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5d/225d4a4d191071c2a8cf042bdab6f931/pa/LN71462_16344e92a0d248807bb358dc8dee761c.jpg',
             'Width': 1499}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H2 Club Start&Stop',
 'year': 2022}
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN71462%27 HTTP/1.1" 200 None
2026-01-28 10:08:47 [auto1.it] INFO: Saving data for LN71462: {'auction_closing_time': 1769702675.0, 'created_time': 1769594927.446947, 'last_price_update_time': 1769594927.446958}
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN71462') HTTP/1.1" 204 0
2026-01-28 10:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 974f465d-f595-532b-8c49-1161ef940ef4 with identifier: MV90862
2026-01-28 10:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 974f465d-f595-532b-8c49-1161ef940ef4 with identifier: MV90862
2026-01-28 10:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 974f465d-f595-532b-8c49-1161ef940ef4 with identifier: MV90862 to the API
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MV90862>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:01:18Z',
 'fuel_type': 'diesel',
 'id': '974f465d-f595-532b-8c49-1161ef940ef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV90862',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 43864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV90862%27 HTTP/1.1" 200 None
2026-01-28 10:08:47 [auto1.it] INFO: Saving data for MV90862: {'auction_closing_time': 1769702478.0, 'created_time': 1769421636.437124, 'last_price_update_time': 1769594927.855193}
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MV90862') HTTP/1.1" 204 0
2026-01-28 10:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE87836> (referer: https://www.auto1.com/v1/car-details-view/NE87836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ41788> (referer: https://www.auto1.com/v1/car-details-view/GZ41788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY86470> (referer: https://www.auto1.com/v1/car-details-view/XY86470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE66733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM21779> (referer: https://www.auto1.com/v1/car-details-view/NM21779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef0c4d0>
2026-01-28 10:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_929970e603c7d8b30b6ba7321577973b.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_929970e603c7d8b30b6ba7321577973b.jpg saved to cache
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eef0cc50>
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_9941ad7129c03610d1a7db53be4ac397.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9941ad7129c03610d1a7db53be4ac397.jpg saved to cache
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eefdba90>
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_7abe348fa463b697890cf983f408fb08.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7abe348fa463b697890cf983f408fb08.jpg saved to cache
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_50a3ef90f77fb86bf14ecc338628da37.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_52e63018857646f5dc47dba0a6155fbb.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM48651> (referer: https://www.auto1.com/v1/car-details-view/EM48651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with identifier: NE87836
2026-01-28 10:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5, identifier: NE87836
2026-01-28 10:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae06c04-24a4-5f85-be69-54923fc40a30 with identifier: GZ41788
2026-01-28 10:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae06c04-24a4-5f85-be69-54923fc40a30 with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae06c04-24a4-5f85-be69-54923fc40a30 with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ae06c04-24a4-5f85-be69-54923fc40a30, identifier: GZ41788
2026-01-28 10:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300a77f9-1fca-56e9-bc68-1701c5867dbe with identifier: XY86470
2026-01-28 10:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300a77f9-1fca-56e9-bc68-1701c5867dbe with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300a77f9-1fca-56e9-bc68-1701c5867dbe with scrape type 2
2026-01-28 10:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 300a77f9-1fca-56e9-bc68-1701c5867dbe, identifier: XY86470
2026-01-28 10:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8 with identifier: NM21779
2026-01-28 10:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8 with scrape type 1
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_076b4faed9f7a62168f0f56d4406fd02.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_076b4faed9f7a62168f0f56d4406fd02.jpg already downloaded
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_3e882c48e66405d9eba3f5f091c89201.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3e882c48e66405d9eba3f5f091c89201.jpg already downloaded
2026-01-28 10:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_42ff18bf8e57becd6574bfc3417a6428.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_42ff18bf8e57becd6574bfc3417a6428.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_a76c79606a6ece79e49cea9e57516c95.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a76c79606a6ece79e49cea9e57516c95.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_21b7bf8b9840dfee59f1283e820d5b82.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_21b7bf8b9840dfee59f1283e820d5b82.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_9db281bd62dd812eeaf79573db3f6a99.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_9db281bd62dd812eeaf79573db3f6a99.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_56415ca571fc6c2cd9f8d81f9431409e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_56415ca571fc6c2cd9f8d81f9431409e.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_973d9ccccca08885167cfe310c81b89e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_973d9ccccca08885167cfe310c81b89e.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_75272c52c82c70649b688528068aac81.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_75272c52c82c70649b688528068aac81.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_2ca24b738b6919bc529fa9af3ae9a95d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_2ca24b738b6919bc529fa9af3ae9a95d.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_b3b8b339be64b404b5394bccc621f9a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b3b8b339be64b404b5394bccc621f9a5.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_3c7e89755796f67437e93a97de92f426.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3c7e89755796f67437e93a97de92f426.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_b673a33e3d6263218cab8d9f7f3ed64e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b673a33e3d6263218cab8d9f7f3ed64e.jpg already downloaded
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fa8%252F4ca88b1ffa8685bf6f83831ffd065692%252Fpa%252FNM21779_a221974bae0332db547d5624776ca555.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a221974bae0332db547d5624776ca555.jpg already downloaded
2026-01-28 10:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8, identifier: NM21779
2026-01-28 10:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with identifier: NE87836
2026-01-28 10:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with identifier: NE87836
2026-01-28 10:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5 with identifier: NE87836 to the API
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE87836>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:33:52Z',
 'fuel_type': 'hybrid',
 'id': 'e17eb0f1-2171-5540-ad76-a1dc0dd6b6c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE87836',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 40379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Style',
 'transmission': 'automatic',
 'trim': '4x2 Style',
 'year': 2024}
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE87836%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [auto1.it] INFO: Saving data for NE87836: {'auction_closing_time': 1769704432.0, 'created_time': 1768421219.01664, 'last_price_update_time': 1769594929.587641}
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE87836') HTTP/1.1" 204 0
2026-01-28 10:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ae06c04-24a4-5f85-be69-54923fc40a30 with identifier: GZ41788
2026-01-28 10:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ae06c04-24a4-5f85-be69-54923fc40a30 with identifier: GZ41788
2026-01-28 10:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ae06c04-24a4-5f85-be69-54923fc40a30 with identifier: GZ41788 to the API
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ41788>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:18:13Z',
 'fuel_type': 'petrol',
 'id': '8ae06c04-24a4-5f85-be69-54923fc40a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ41788',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 51002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ41788%27 HTTP/1.1" 200 None
2026-01-28 10:08:49 [auto1.it] INFO: Saving data for GZ41788: {'auction_closing_time': 1769703493.0, 'created_time': 1768248503.653412, 'last_price_update_time': 1769594929.884795}
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ41788') HTTP/1.1" 204 0
2026-01-28 10:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 300a77f9-1fca-56e9-bc68-1701c5867dbe with identifier: XY86470
2026-01-28 10:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 300a77f9-1fca-56e9-bc68-1701c5867dbe with identifier: XY86470
2026-01-28 10:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-28 10:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 300a77f9-1fca-56e9-bc68-1701c5867dbe spider: auto1.it
2026-01-28 10:08:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 300a77f9-1fca-56e9-bc68-1701c5867dbe due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-01-29T16:39:43Z',
 'fuel_type': 'petrol',
 'id': '300a77f9-1fca-56e9-bc68-1701c5867dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY86470',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 47930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 0.9 4x4',
 'transmission': 'manual',
 'trim': '4x4',
 'year': 2020}
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY86470%27 HTTP/1.1" 200 None
2026-01-28 10:08:50 [auto1.it] INFO: Saving data for XY86470: {'auction_closing_time': 1769704783.0, 'created_time': 1768420949.211232, 'last_price_update_time': 1769594930.112042}
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY86470') HTTP/1.1" 204 0
2026-01-28 10:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8 with identifier: NM21779
2026-01-28 10:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8 with identifier: NM21779
2026-01-28 10:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 061655f1-a8eb-5b5a-8a59-8d59ddfeacb8 with identifier: NM21779 to the API
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM21779>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 193,
 'expiration_date': '2026-01-29T16:24:59Z',
 'fuel_type': 'diesel',
 'id': '061655f1-a8eb-5b5a-8a59-8d59ddfeacb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM21779',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 27688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_076b4faed9f7a62168f0f56d4406fd02.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3e882c48e66405d9eba3f5f091c89201.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_42ff18bf8e57becd6574bfc3417a6428.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a76c79606a6ece79e49cea9e57516c95.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_21b7bf8b9840dfee59f1283e820d5b82.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_9db281bd62dd812eeaf79573db3f6a99.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_56415ca571fc6c2cd9f8d81f9431409e.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_973d9ccccca08885167cfe310c81b89e.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_75272c52c82c70649b688528068aac81.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_2ca24b738b6919bc529fa9af3ae9a95d.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b3b8b339be64b404b5394bccc621f9a5.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3c7e89755796f67437e93a97de92f426.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b673a33e3d6263218cab8d9f7f3ed64e.jpg',
                'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a221974bae0332db547d5624776ca555.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_076b4faed9f7a62168f0f56d4406fd02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3e882c48e66405d9eba3f5f091c89201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_42ff18bf8e57becd6574bfc3417a6428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a76c79606a6ece79e49cea9e57516c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_21b7bf8b9840dfee59f1283e820d5b82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_9db281bd62dd812eeaf79573db3f6a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_56415ca571fc6c2cd9f8d81f9431409e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_973d9ccccca08885167cfe310c81b89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_75272c52c82c70649b688528068aac81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_2ca24b738b6919bc529fa9af3ae9a95d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b3b8b339be64b404b5394bccc621f9a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_3c7e89755796f67437e93a97de92f426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_b673a33e3d6263218cab8d9f7f3ed64e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061655f1-a8eb-5b5a-8a59-8d59ddfeacb8/061655f1-a8eb-5b5a-8a59-8d59ddfeacb8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/a8/4ca88b1ffa8685bf6f83831ffd065692/pa/NM21779_a221974bae0332db547d5624776ca555.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM21779%27 HTTP/1.1" 200 None
2026-01-28 10:08:50 [auto1.it] INFO: Saving data for NM21779: {'auction_closing_time': 1769703899.0, 'created_time': 1769594930.404182, 'last_price_update_time': 1769594930.404193}
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM21779') HTTP/1.1" 204 0
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40c67d0>
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Fc6%252F1ec6a76003092f4d6ea2b1e27492a18a%252Fpa%252FUU45503_50a3ef90f77fb86bf14ecc338628da37.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_50a3ef90f77fb86bf14ecc338628da37.jpg saved to cache
2026-01-28 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3dd88d52-3011-56c3-8f75-39da084dbf89
2026-01-28 10:08:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3dd88d52-3011-56c3-8f75-39da084dbf89, skipping ID generation
2026-01-28 10:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dd88d52-3011-56c3-8f75-39da084dbf89 with scrape type 1
2026-01-28 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3dd88d52-3011-56c3-8f75-39da084dbf89 from tracking dictionaries
2026-01-28 10:08:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3dd88d52-3011-56c3-8f75-39da084dbf89 sending to next pipeline
2026-01-28 10:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3dd88d52-3011-56c3-8f75-39da084dbf89, identifier: UU45503
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39f40667d0>
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fc4%252F3ac44707b1d933fd8ef55543ef11525e%252Fpa%252FCK01527_52e63018857646f5dc47dba0a6155fbb.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_52e63018857646f5dc47dba0a6155fbb.jpg saved to cache
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec7bc138-991e-540b-b159-18b4ef230252
2026-01-28 10:08:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec7bc138-991e-540b-b159-18b4ef230252, skipping ID generation
2026-01-28 10:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec7bc138-991e-540b-b159-18b4ef230252 with scrape type 1
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ec7bc138-991e-540b-b159-18b4ef230252 from tracking dictionaries
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec7bc138-991e-540b-b159-18b4ef230252 sending to next pipeline
2026-01-28 10:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec7bc138-991e-540b-b159-18b4ef230252, identifier: CK01527
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee492250>
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg saved to cache
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae9728e-6844-5dd8-a413-42b622b95cbe with identifier: EM48651
2026-01-28 10:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae9728e-6844-5dd8-a413-42b622b95cbe with scrape type 2
2026-01-28 10:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae9728e-6844-5dd8-a413-42b622b95cbe with scrape type 2
2026-01-28 10:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ae9728e-6844-5dd8-a413-42b622b95cbe, identifier: EM48651
2026-01-28 10:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3dd88d52-3011-56c3-8f75-39da084dbf89 with identifier: UU45503
2026-01-28 10:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3dd88d52-3011-56c3-8f75-39da084dbf89 with identifier: UU45503
2026-01-28 10:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3dd88d52-3011-56c3-8f75-39da084dbf89 with identifier: UU45503 to the API
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_50a3ef90f77fb86bf14ecc338628da37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:57:20Z',
 'fuel_type': 'petrol',
 'id': '3dd88d52-3011-56c3-8f75-39da084dbf89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU45503',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 25911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7abe348fa463b697890cf983f408fb08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_50a3ef90f77fb86bf14ecc338628da37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_f53c2ebcab75d92ac5a0fa3128ff7b5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_1118a84c979970324980109480956d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_0505a67781aa81b9c3779d83d3487125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_c22ff2dc5b1101b4a8eb2768607e2b80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_37a5419ead8d8f3e5069341c35b66e12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_91992a1098cdd1e4d2b9c9ff1a6985de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_98c1cd760946c9a682432d3788c44b36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_ea6304015fe2c88c1e4cb44a3f4bb7f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_4f4a727eae18304230286294e3b2a298.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7b09231518d32f8efd2ced222c63efd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7599d45b6af9b23a9ee1c7de0709cb14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_6f95786297e88dca9dc39e2174b84be1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dd88d52-3011-56c3-8f75-39da084dbf89/3dd88d52-3011-56c3-8f75-39da084dbf89_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/c6/1ec6a76003092f4d6ea2b1e27492a18a/pa/UU45503_7ebaca697da72898e13b1e887bfe4483.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU45503%27 HTTP/1.1" 200 None
2026-01-28 10:08:51 [auto1.it] INFO: Saving data for UU45503: {'auction_closing_time': 1769705840.0, 'created_time': 1769594931.709676, 'last_price_update_time': 1769594931.709687}
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU45503') HTTP/1.1" 204 0
2026-01-28 10:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec7bc138-991e-540b-b159-18b4ef230252 with identifier: CK01527
2026-01-28 10:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec7bc138-991e-540b-b159-18b4ef230252 with identifier: CK01527
2026-01-28 10:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec7bc138-991e-540b-b159-18b4ef230252 with identifier: CK01527 to the API
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_52e63018857646f5dc47dba0a6155fbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-01-29T16:14:24Z',
 'fuel_type': 'petrol',
 'id': 'ec7bc138-991e-540b-b159-18b4ef230252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK01527',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 11846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9941ad7129c03610d1a7db53be4ac397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_52e63018857646f5dc47dba0a6155fbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_9b1a2d36497734c7c89a3fc93e401613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_44fcb8f5895e13979fe7d4408b9c1e35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7e4509d056643946038377b502ebe365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_935b5320d203249400b747f8b9cb1eb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_61568a1439d8cd22225b3f96578b3ec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_f1473793509d02e8dcf4877dd76514f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_7abef266ff5a7d033e5fbc295610cc3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_820010d3f7be2d29e25d88f6ad1b8364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_8ac6c3c83dc146dfe50ebd07c10d007f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_0032fc7efd7a97dc3186fea96c45660f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_64020a25c8368d24d18bf5f81211ddc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_3ead9f9930f7caf16b232b1c8cc2c4e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec7bc138-991e-540b-b159-18b4ef230252/ec7bc138-991e-540b-b159-18b4ef230252_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/c4/3ac44707b1d933fd8ef55543ef11525e/pa/CK01527_ebd28c17cad12fcfa2f8bbd1ef6fb60d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2024}
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-01-28 10:08:51 [auto1.it] INFO: Saving data for CK01527: {'auction_closing_time': 1769703264.0, 'created_time': 1769594931.985473, 'last_price_update_time': 1769594931.985484}
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK01527') HTTP/1.1" 204 0
2026-01-28 10:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ae9728e-6844-5dd8-a413-42b622b95cbe with identifier: EM48651
2026-01-28 10:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ae9728e-6844-5dd8-a413-42b622b95cbe with identifier: EM48651
2026-01-28 10:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ae9728e-6844-5dd8-a413-42b622b95cbe with identifier: EM48651 to the API
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM48651>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:20:22Z',
 'fuel_type': 'petrol',
 'id': '8ae9728e-6844-5dd8-a413-42b622b95cbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM48651',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Suzuki',
 'model': 'S-Cross',
 'odometer': 42789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki S-Cross 1.4 BoosterJet Mild-Hybrid Top+ 4x4',
 'transmission': 'manual',
 'trim': 'Top+ 4x4',
 'year': 2022}
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM48651%27 HTTP/1.1" 200 None
2026-01-28 10:08:52 [auto1.it] INFO: Saving data for EM48651: {'auction_closing_time': 1769703622.0, 'created_time': 1766001867.287066, 'last_price_update_time': 1769594932.343015}
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EM48651') HTTP/1.1" 204 0
2026-01-28 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH81920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH61995> (referer: https://www.auto1.com/v1/car-details-view/VH61995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_649a7760e84ac808eb17269d6d924ea1.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_66987853574940c9acbca4efa79c5b20.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg> (referer: https://www.auto1.com/)
2026-01-28 10:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a21384-4993-5600-97a9-5c4c094bffcd with identifier: VH61995
2026-01-28 10:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a21384-4993-5600-97a9-5c4c094bffcd with scrape type 2
2026-01-28 10:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a21384-4993-5600-97a9-5c4c094bffcd with scrape type 2
2026-01-28 10:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 45a21384-4993-5600-97a9-5c4c094bffcd, identifier: VH61995
2026-01-28 10:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 45a21384-4993-5600-97a9-5c4c094bffcd with identifier: VH61995
2026-01-28 10:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 45a21384-4993-5600-97a9-5c4c094bffcd with identifier: VH61995
2026-01-28 10:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 45a21384-4993-5600-97a9-5c4c094bffcd with identifier: VH61995 to the API
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH61995>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-01-28T16:44:52Z',
 'fuel_type': 'diesel',
 'id': '45a21384-4993-5600-97a9-5c4c094bffcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61995',
 'listing': 'auction',
 'location': 'IT, Casamassima',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 93003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 250 d 4Matic BlueTEC Sport',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Sport',
 'year': 2018}
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH61995%27 HTTP/1.1" 200 None
2026-01-28 10:08:52 [auto1.it] INFO: Saving data for VH61995: {'auction_closing_time': 1769618692.0, 'created_time': 1769410835.487736, 'last_price_update_time': 1769594932.86128}
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH61995') HTTP/1.1" 204 0
2026-01-28 10:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee401b50>
2026-01-28 10:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_1.jpg HTTP/1.1" 201 0
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Fc1%252Fa0c1455e3223d29f0006e66591888236%252Fpa%252FLB37983_649a7760e84ac808eb17269d6d924ea1.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_649a7760e84ac808eb17269d6d924ea1.jpg saved to cache
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e865f06-6d50-5d09-933e-474d59efc181
2026-01-28 10:08:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e865f06-6d50-5d09-933e-474d59efc181, skipping ID generation
2026-01-28 10:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e865f06-6d50-5d09-933e-474d59efc181 with scrape type 1
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e865f06-6d50-5d09-933e-474d59efc181 from tracking dictionaries
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e865f06-6d50-5d09-933e-474d59efc181 sending to next pipeline
2026-01-28 10:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9e865f06-6d50-5d09-933e-474d59efc181, identifier: LB37983
2026-01-28 10:08:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39eee9d9d0>
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252Fd9%252Ff9d900d683e1bf5b24a01df7b9969cfc%252Fpa%252FRE03903_66987853574940c9acbca4efa79c5b20.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_66987853574940c9acbca4efa79c5b20.jpg saved to cache
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6390e9e-f1bd-5c80-84bd-afadf07279a9
2026-01-28 10:08:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6390e9e-f1bd-5c80-84bd-afadf07279a9, skipping ID generation
2026-01-28 10:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6390e9e-f1bd-5c80-84bd-afadf07279a9 with scrape type 1
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6390e9e-f1bd-5c80-84bd-afadf07279a9 from tracking dictionaries
2026-01-28 10:08:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6390e9e-f1bd-5c80-84bd-afadf07279a9 sending to next pipeline
2026-01-28 10:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6390e9e-f1bd-5c80-84bd-afadf07279a9, identifier: RE03903
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f39ee5194d0>
2026-01-28 10:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 10:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 10:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_0.jpg HTTP/1.1" 201 0
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fcd%252F65cd433abb2e396b629363753e3c644f%252Fpa%252FUV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg') HTTP/1.1" 204 0
2026-01-28 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg saved to cache
2026-01-28 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84849814-c697-581c-8f67-dc0e48c12982
2026-01-28 10:08:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84849814-c697-581c-8f67-dc0e48c12982, skipping ID generation
2026-01-28 10:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84849814-c697-581c-8f67-dc0e48c12982 with scrape type 1
2026-01-28 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84849814-c697-581c-8f67-dc0e48c12982 from tracking dictionaries
2026-01-28 10:08:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84849814-c697-581c-8f67-dc0e48c12982 sending to next pipeline
2026-01-28 10:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84849814-c697-581c-8f67-dc0e48c12982, identifier: UV42227
2026-01-28 10:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9e865f06-6d50-5d09-933e-474d59efc181 with identifier: LB37983
2026-01-28 10:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9e865f06-6d50-5d09-933e-474d59efc181 with identifier: LB37983
2026-01-28 10:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9e865f06-6d50-5d09-933e-474d59efc181 with identifier: LB37983 to the API
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_649a7760e84ac808eb17269d6d924ea1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 211,
 'expiration_date': '2026-01-29T16:02:44Z',
 'fuel_type': 'hybrid',
 'id': '9e865f06-6d50-5d09-933e-474d59efc181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB37983',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 45451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_929970e603c7d8b30b6ba7321577973b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_649a7760e84ac808eb17269d6d924ea1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_e4fc6ea4ee0b2d4f581d6ab89bf63518.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_819885d43ddd8b81f96bd642b378da8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638444,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_61571c2ae3b651f403837afdd92ca593.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661888,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_b9a89d0777bce5584e4d940e9cbe56d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2724836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_ef9455dc05b74eb361745e004a2ca583.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_95dae2f1ba195d951a45c32aa00dab55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_d4fc962297c706cdd20f35c414d7340b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_da8988b7b88e64659cc72b9e695427f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_a36cdc1df4a937b505e5df62701d33cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_69ef35dbe28061fa9f7f2f17993f41e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_cc11ca629855ac91de54efb851e96b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_5d4c5fe138e6fa29bdd1a90e24183a4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e865f06-6d50-5d09-933e-474d59efc181/9e865f06-6d50-5d09-933e-474d59efc181_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/c1/a0c1455e3223d29f0006e66591888236/pa/LB37983_24db84110b8b47a8685e49900fbddc40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB37983%27 HTTP/1.1" 200 None
2026-01-28 10:08:54 [auto1.it] INFO: Saving data for LB37983: {'auction_closing_time': 1769702564.0, 'created_time': 1769594934.68184, 'last_price_update_time': 1769594934.681852}
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB37983') HTTP/1.1" 204 0
2026-01-28 10:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6390e9e-f1bd-5c80-84bd-afadf07279a9 with identifier: RE03903
2026-01-28 10:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6390e9e-f1bd-5c80-84bd-afadf07279a9 with identifier: RE03903
2026-01-28 10:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6390e9e-f1bd-5c80-84bd-afadf07279a9 with identifier: RE03903 to the API
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_66987853574940c9acbca4efa79c5b20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:26:55Z',
 'fuel_type': 'diesel',
 'id': 'a6390e9e-f1bd-5c80-84bd-afadf07279a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE03903',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 35583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3175212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_66987853574940c9acbca4efa79c5b20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_b53fd0eba2ff6b5550f6ac6ece742d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e7a3f261c0deb525e3faea41fa13c2f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_f0801ff085bcec01e289e6fc627afe05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_8164b0890fac9a4039a28e1c1b31b19e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_e9094c01eafdef2c87a223ff39c99d2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2924595,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_63348f9fb6e63997859057413b67cdab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066458,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_4a4056f1a1af05a775648757872ec4c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3209135,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ef2975fdbaede85d9d8dd23695c303d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_a684a039261b225ed31717f0e21a0f0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_0a828df5beead0040b9eb27a1467c9de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3093395,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_5c614f234c43ab06da1f3f67bdd105e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_09427b807b455e072994ec72b6076c91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_999c39a87c0f797b7f8a59b5241d7e80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6390e9e-f1bd-5c80-84bd-afadf07279a9/a6390e9e-f1bd-5c80-84bd-afadf07279a9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/d9/f9d900d683e1bf5b24a01df7b9969cfc/pa/RE03903_ccbed7abf04185d1aa6a9f8823d999e2.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2021}
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE03903%27 HTTP/1.1" 200 None
2026-01-28 10:08:54 [auto1.it] INFO: Saving data for RE03903: {'auction_closing_time': 1769704015.0, 'created_time': 1769594934.980757, 'last_price_update_time': 1769594934.98077}
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE03903') HTTP/1.1" 204 0
2026-01-28 10:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84849814-c697-581c-8f67-dc0e48c12982 with identifier: UV42227
2026-01-28 10:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84849814-c697-581c-8f67-dc0e48c12982 with identifier: UV42227
2026-01-28 10:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160649 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160649
2026-01-28 10:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 84849814-c697-581c-8f67-dc0e48c12982 spider: auto1.it
2026-01-28 10:08:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 84849814-c697-581c-8f67-dc0e48c12982 due to rule: high_mileage_for_country.json, error: 160649 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160649
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-01-29T16:21:35Z',
 'fuel_type': 'diesel',
 'id': '84849814-c697-581c-8f67-dc0e48c12982',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV42227',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 160649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4494127,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_5022abb7fd19139c2b96f365aaa4d02a.jpg',
             'Width': 3751},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4494127,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_ed026bd42465ea368bbebcfe0116ca5e.jpg',
             'Width': 3751},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4432666,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_a1572dc45fa1de9c79dab032ea8f6815.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3857429,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_9d9b9301a27f0c14f3fbe3b542443cf4.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4821755,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_4d6b5790b3d2577c5b099974f7929252.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_72830f8a810d99b301d8b554857f0060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3699301,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_a5500a527fee46615fa2f0802ad5f920.jpg',
             'Width': 3553},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_6772f50f0fa3b57af4870d7cff99bfc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_649eeb22747b0d304660bb5b91931dc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4140296,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_559557a3fbbe67fb4ea705440436d52a.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_cd5eec482bbbd39672b09af5226be669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3287723,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_606a71dcfacac94aaf51e900514e8c74.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4424038,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_902c4dd89f1ccd0287d4e025ed902c28.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84849814-c697-581c-8f67-dc0e48c12982/84849814-c697-581c-8f67-dc0e48c12982_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/cd/65cd433abb2e396b629363753e3c644f/pa/UV42227_f72efc141af98671a019a9219a5b3735.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2023}
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV42227%27 HTTP/1.1" 200 None
2026-01-28 10:08:55 [auto1.it] INFO: Saving data for UV42227: {'auction_closing_time': 1769703695.0, 'created_time': 1769594935.202951, 'last_price_update_time': 1769594935.202964}
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV42227') HTTP/1.1" 204 0
2026-01-28 10:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU90270> (referer: https://www.auto1.com/v1/car-details-view/DU90270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW83792/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dceb0cd-200a-5585-940a-be9c1a69574c with identifier: DU90270
2026-01-28 10:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dceb0cd-200a-5585-940a-be9c1a69574c with scrape type 2
2026-01-28 10:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dceb0cd-200a-5585-940a-be9c1a69574c with scrape type 2
2026-01-28 10:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dceb0cd-200a-5585-940a-be9c1a69574c, identifier: DU90270
2026-01-28 10:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dceb0cd-200a-5585-940a-be9c1a69574c with identifier: DU90270
2026-01-28 10:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dceb0cd-200a-5585-940a-be9c1a69574c with identifier: DU90270
2026-01-28 10:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dceb0cd-200a-5585-940a-be9c1a69574c with identifier: DU90270 to the API
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU90270>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:56:01Z',
 'fuel_type': 'hybrid',
 'id': '2dceb0cd-200a-5585-940a-be9c1a69574c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU90270',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 22577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2021}
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU90270%27 HTTP/1.1" 200 None
2026-01-28 10:08:55 [auto1.it] INFO: Saving data for DU90270: {'auction_closing_time': 1769705761.0, 'created_time': 1768377704.359066, 'last_price_update_time': 1769594935.839754}
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU90270') HTTP/1.1" 204 0
2026-01-28 10:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD53703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK19049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:08:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.002(s), this was the 1st time calling it.
2026-01-28 10:08:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.830159812009865 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH81920> (referer: https://www.auto1.com/v1/car-details-view/TH81920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9bef6f7-1864-5580-9973-9efbeb8dfcbc with identifier: TH81920
2026-01-28 10:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9bef6f7-1864-5580-9973-9efbeb8dfcbc with scrape type 1
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b9bef6f7-1864-5580-9973-9efbeb8dfcbc
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_6cc8a465372a3208863c811bcccb961e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_6cc8a465372a3208863c811bcccb961e.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_bf1f9825cb2d99cda38a67961d0d5855.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_bf1f9825cb2d99cda38a67961d0d5855.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_415b78b247dc204edd5f4b2e21d47183.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_415b78b247dc204edd5f4b2e21d47183.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_cf6c5bdc7cbd73845b43ac249634e4bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_cf6c5bdc7cbd73845b43ac249634e4bb.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_224f318ae654f5e41117bc9a0d1c6c4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_224f318ae654f5e41117bc9a0d1c6c4c.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_76959d7e61f81871af29759365958741.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_76959d7e61f81871af29759365958741.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_7d953d04cb4cf90d07803aca8719bbf9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_7d953d04cb4cf90d07803aca8719bbf9.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_e305fe222db4ec449173f3146d358117.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_e305fe222db4ec449173f3146d358117.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_d6ff7272484053e3664e2b9017a5e9ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_d6ff7272484053e3664e2b9017a5e9ac.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_27fbb08d99cb91c7f8b8ef741df0f75e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_27fbb08d99cb91c7f8b8ef741df0f75e.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_01c3975067b602d7c809f46658d14e16.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_01c3975067b602d7c809f46658d14e16.jpg already downloaded
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_9767c945eb35037f608e10b920534b27.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_9767c945eb35037f608e10b920534b27.jpg already downloaded
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_b291f13fed7f07158b84f42958f3df6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_b291f13fed7f07158b84f42958f3df6e.jpg already downloaded
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_ab328eac1f3bd262873e104f5a6806f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_ab328eac1f3bd262873e104f5a6806f7.jpg already downloaded
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe1%252F74e1647c228633209aa371bf4f80f6bb%252Fpa%252FTH81920_324624b6b217d9e090f0f4bd545b6057.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_324624b6b217d9e090f0f4bd545b6057.jpg already downloaded
2026-01-28 10:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9bef6f7-1864-5580-9973-9efbeb8dfcbc, identifier: TH81920
2026-01-28 10:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9bef6f7-1864-5580-9973-9efbeb8dfcbc with identifier: TH81920
2026-01-28 10:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9bef6f7-1864-5580-9973-9efbeb8dfcbc with identifier: TH81920
2026-01-28 10:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
2026-01-28 10:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b9bef6f7-1864-5580-9973-9efbeb8dfcbc spider: auto1.it
2026-01-28 10:09:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b9bef6f7-1864-5580-9973-9efbeb8dfcbc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo courier' containing 'courier'
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:04:05Z',
 'fuel_type': 'petrol',
 'id': 'b9bef6f7-1864-5580-9973-9efbeb8dfcbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH81920',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Ford',
 'model': 'Tourneo Courier',
 'odometer': 3397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_6cc8a465372a3208863c811bcccb961e.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_bf1f9825cb2d99cda38a67961d0d5855.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_415b78b247dc204edd5f4b2e21d47183.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_cf6c5bdc7cbd73845b43ac249634e4bb.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_224f318ae654f5e41117bc9a0d1c6c4c.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_76959d7e61f81871af29759365958741.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_7d953d04cb4cf90d07803aca8719bbf9.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_e305fe222db4ec449173f3146d358117.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_d6ff7272484053e3664e2b9017a5e9ac.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_27fbb08d99cb91c7f8b8ef741df0f75e.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_01c3975067b602d7c809f46658d14e16.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_9767c945eb35037f608e10b920534b27.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_b291f13fed7f07158b84f42958f3df6e.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_ab328eac1f3bd262873e104f5a6806f7.jpg',
                'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_324624b6b217d9e090f0f4bd545b6057.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3191817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_6cc8a465372a3208863c811bcccb961e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_bf1f9825cb2d99cda38a67961d0d5855.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_415b78b247dc204edd5f4b2e21d47183.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372960,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_cf6c5bdc7cbd73845b43ac249634e4bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_224f318ae654f5e41117bc9a0d1c6c4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_76959d7e61f81871af29759365958741.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_7d953d04cb4cf90d07803aca8719bbf9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905050,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_e305fe222db4ec449173f3146d358117.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_d6ff7272484053e3664e2b9017a5e9ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_27fbb08d99cb91c7f8b8ef741df0f75e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_01c3975067b602d7c809f46658d14e16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_9767c945eb35037f608e10b920534b27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_b291f13fed7f07158b84f42958f3df6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2443541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_ab328eac1f3bd262873e104f5a6806f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9bef6f7-1864-5580-9973-9efbeb8dfcbc/b9bef6f7-1864-5580-9973-9efbeb8dfcbc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e1/74e1647c228633209aa371bf4f80f6bb/pa/TH81920_324624b6b217d9e090f0f4bd545b6057.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Courier 1.0 EcoBoost Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2024}
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH81920%27 HTTP/1.1" 200 None
2026-01-28 10:09:03 [auto1.it] INFO: Saving data for TH81920: {'auction_closing_time': 1769702645.0, 'created_time': 1769594943.386734, 'last_price_update_time': 1769594943.386743}
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH81920') HTTP/1.1" 204 0
2026-01-28 10:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE66733> (referer: https://www.auto1.com/v1/car-details-view/NE66733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f406f949-fc04-55da-8710-b6428c855bb1 with identifier: NE66733
2026-01-28 10:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f406f949-fc04-55da-8710-b6428c855bb1 with scrape type 2
2026-01-28 10:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f406f949-fc04-55da-8710-b6428c855bb1 with scrape type 2
2026-01-28 10:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f406f949-fc04-55da-8710-b6428c855bb1, identifier: NE66733
2026-01-28 10:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f406f949-fc04-55da-8710-b6428c855bb1 with identifier: NE66733
2026-01-28 10:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f406f949-fc04-55da-8710-b6428c855bb1 with identifier: NE66733
2026-01-28 10:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f406f949-fc04-55da-8710-b6428c855bb1 with identifier: NE66733 to the API
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE66733>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:27:16Z',
 'fuel_type': 'hybrid',
 'id': 'f406f949-fc04-55da-8710-b6428c855bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE66733',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 106393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid Connect',
 'transmission': 'automatic',
 'trim': 'Connect',
 'year': 2022}
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE66733%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [auto1.it] INFO: Saving data for NE66733: {'auction_closing_time': 1769704036.0, 'created_time': 1769198555.431831, 'last_price_update_time': 1769594944.034869}
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE66733') HTTP/1.1" 204 0
2026-01-28 10:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW83792> (referer: https://www.auto1.com/v1/car-details-view/AW83792/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52126b1-9173-5fee-8ae9-c97f736d5c0a with identifier: AW83792
2026-01-28 10:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52126b1-9173-5fee-8ae9-c97f736d5c0a with scrape type 1
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a52126b1-9173-5fee-8ae9-c97f736d5c0a
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_f971247d65b6b1859bd724530048d92a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f971247d65b6b1859bd724530048d92a.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_e2f9e503ee897488d4460f369e301f74.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_e2f9e503ee897488d4460f369e301f74.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_ccdec89b32732fc1500cf1e404867a7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ccdec89b32732fc1500cf1e404867a7d.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_17a93b7364f2eae93156e283aa50dd35.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_17a93b7364f2eae93156e283aa50dd35.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_03b1cc72543012e7b18fdd4ea1a7f93b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_03b1cc72543012e7b18fdd4ea1a7f93b.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_2ba6ab48e38214d97a6cf755990b4706.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_2ba6ab48e38214d97a6cf755990b4706.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_d4dbf0556fcaae70e5f0d75b20734d73.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d4dbf0556fcaae70e5f0d75b20734d73.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_f36862573a26cc0dfde15be36f561a37.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f36862573a26cc0dfde15be36f561a37.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_39aa9fe57cba6e8a6f6185e4f2d523cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_39aa9fe57cba6e8a6f6185e4f2d523cf.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_6ee6bddc7ed984b4590c02101dee4268.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_6ee6bddc7ed984b4590c02101dee4268.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_ee19d84e4a8498124a0cf1d916567fff.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ee19d84e4a8498124a0cf1d916567fff.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_508d9601503c461e4c538c0ec11cae94.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_508d9601503c461e4c538c0ec11cae94.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_9168f67a04b4d869f9b0deb387efdd8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_9168f67a04b4d869f9b0deb387efdd8f.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_0f5d11bcb0f4c6f4c7de746a4fa0af7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_0f5d11bcb0f4c6f4c7de746a4fa0af7a.jpg already downloaded
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F1e%252Fcb1eb0df1bc837d93b24623bce78073f%252Fpa%252FAW83792_d0dac472c577fcca6eb3ec75e9db3959.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d0dac472c577fcca6eb3ec75e9db3959.jpg already downloaded
2026-01-28 10:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a52126b1-9173-5fee-8ae9-c97f736d5c0a, identifier: AW83792
2026-01-28 10:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a52126b1-9173-5fee-8ae9-c97f736d5c0a with identifier: AW83792
2026-01-28 10:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a52126b1-9173-5fee-8ae9-c97f736d5c0a with identifier: AW83792
2026-01-28 10:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a52126b1-9173-5fee-8ae9-c97f736d5c0a with identifier: AW83792 to the API
2026-01-28 10:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW83792>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:34:28Z',
 'fuel_type': 'diesel',
 'id': 'a52126b1-9173-5fee-8ae9-c97f736d5c0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW83792',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 112353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f971247d65b6b1859bd724530048d92a.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_e2f9e503ee897488d4460f369e301f74.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ccdec89b32732fc1500cf1e404867a7d.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_17a93b7364f2eae93156e283aa50dd35.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_03b1cc72543012e7b18fdd4ea1a7f93b.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_2ba6ab48e38214d97a6cf755990b4706.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d4dbf0556fcaae70e5f0d75b20734d73.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f36862573a26cc0dfde15be36f561a37.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_39aa9fe57cba6e8a6f6185e4f2d523cf.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_6ee6bddc7ed984b4590c02101dee4268.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ee19d84e4a8498124a0cf1d916567fff.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_508d9601503c461e4c538c0ec11cae94.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_9168f67a04b4d869f9b0deb387efdd8f.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_0f5d11bcb0f4c6f4c7de746a4fa0af7a.jpg',
                'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d0dac472c577fcca6eb3ec75e9db3959.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f971247d65b6b1859bd724530048d92a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_e2f9e503ee897488d4460f369e301f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ccdec89b32732fc1500cf1e404867a7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_17a93b7364f2eae93156e283aa50dd35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_03b1cc72543012e7b18fdd4ea1a7f93b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_2ba6ab48e38214d97a6cf755990b4706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d4dbf0556fcaae70e5f0d75b20734d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_f36862573a26cc0dfde15be36f561a37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_39aa9fe57cba6e8a6f6185e4f2d523cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2186437,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_6ee6bddc7ed984b4590c02101dee4268.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_ee19d84e4a8498124a0cf1d916567fff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2204002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_508d9601503c461e4c538c0ec11cae94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_9168f67a04b4d869f9b0deb387efdd8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_0f5d11bcb0f4c6f4c7de746a4fa0af7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52126b1-9173-5fee-8ae9-c97f736d5c0a/a52126b1-9173-5fee-8ae9-c97f736d5c0a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/1e/cb1eb0df1bc837d93b24623bce78073f/pa/AW83792_d0dac472c577fcca6eb3ec75e9db3959.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 2.0 CDTI INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2018}
2026-01-28 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83792%27 HTTP/1.1" 200 None
2026-01-28 10:09:05 [auto1.it] INFO: Saving data for AW83792: {'auction_closing_time': 1769704468.0, 'created_time': 1769594945.165124, 'last_price_update_time': 1769594945.165135}
2026-01-28 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW83792') HTTP/1.1" 204 0
2026-01-28 10:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK07610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:06 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: YY06074
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for YY06074: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: GR38482
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for GR38482: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: PX08238
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX08238%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for PX08238: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: LK01725
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK01725%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for LK01725: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: FJ30695
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ30695%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for FJ30695: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: VH04520
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for VH04520: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: SN16265
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN16265%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for SN16265: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: TF46047
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF46047%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for TF46047: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: BR13535
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR13535%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for BR13535: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: LP49742
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP49742%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for LP49742: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: KZ21424
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ21424%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for KZ21424: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: TD65614
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD65614%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for TD65614: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: TH12767
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for TH12767: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: VW18274
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW18274%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for VW18274: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: GY89378
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for GY89378: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: HA18231
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA18231%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for HA18231: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: NC94766
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for NC94766: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: FG14287
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for FG14287: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: EY68102
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY68102%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for EY68102: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: XN08896
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for XN08896: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: WN73794
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN73794%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for WN73794: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: NX59013
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for NX59013: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: FG75193
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for FG75193: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: GH67198
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for GH67198: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: KV39330
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for KV39330: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: YG52761
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG52761%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for YG52761: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: EG40810
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for EG40810: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: GE60272
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE60272%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for GE60272: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: AV71014
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for AV71014: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: WB82138
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for WB82138: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: BB49815
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB49815%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for BB49815: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: XW65998
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW65998%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for XW65998: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: AF20385
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF20385%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for AF20385: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: NJ84699
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ84699%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for NJ84699: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: EG37801
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for EG37801: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: VY49338
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for VY49338: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: XT65171
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT65171%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for XT65171: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: JJ54173
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ54173%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for JJ54173: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: DL88006
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for DL88006: 0
2026-01-28 10:09:06 [auto1.it] INFO: Found listing with ID: PM77932
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77932%27 HTTP/1.1" 200 None
2026-01-28 10:09:06 [auto1.it] INFO: Scrape type for PM77932: 0
2026-01-28 10:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ34330> (referer: https://www.auto1.com/v1/car-details-view/ZZ34330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:09 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: MR32652
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR32652%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for MR32652: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: RN67455
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for RN67455: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: YL53737
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for YL53737: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: PS84479
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for PS84479: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UM80859
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM80859%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UM80859: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: JF49505
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for JF49505: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: JS38459
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for JS38459: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: EA57164
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for EA57164: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: RD39232
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for RD39232: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: EJ52499
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for EJ52499: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UY66715
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY66715%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UY66715: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: MW43217
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW43217%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for MW43217: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: NR13454
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for NR13454: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: YN54929
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN54929%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for YN54929: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: KE68041
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for KE68041: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: GJ74171
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for GJ74171: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: RD72134
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD72134%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for RD72134: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: FT72404
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for FT72404: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: TY16780
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY16780%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for TY16780: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: EN58298
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN58298%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for EN58298: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: JP28374
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP28374%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for JP28374: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: NP55119
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for NP55119: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: FU93011
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU93011%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for FU93011: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: DA86782
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA86782%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for DA86782: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: SL36672
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for SL36672: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: YF34887
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF34887%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for YF34887: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UA81726
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UA81726: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: BY98220
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY98220%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for BY98220: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: XL30417
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for XL30417: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: RN18613
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN18613%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for RN18613: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: JH21247
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for JH21247: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: AY21953
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for AY21953: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: FR46544
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR46544%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for FR46544: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UL75822
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UL75822: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UU21154
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UU21154: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: ZB40645
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for ZB40645: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: VW84140
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW84140%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for VW84140: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: ZX13232
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for ZX13232: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: KH16920
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH16920%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for KH16920: 0
2026-01-28 10:09:09 [auto1.it] INFO: Found listing with ID: UJ20487
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ20487%27 HTTP/1.1" 200 None
2026-01-28 10:09:09 [auto1.it] INFO: Scrape type for UJ20487: 0
2026-01-28 10:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with identifier: ZZ34330
2026-01-28 10:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with scrape type 2
2026-01-28 10:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with scrape type 2
2026-01-28 10:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46fdcc49-3adb-535b-9e21-34e62eefd5e1, identifier: ZZ34330
2026-01-28 10:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with identifier: ZZ34330
2026-01-28 10:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with identifier: ZZ34330
2026-01-28 10:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46fdcc49-3adb-535b-9e21-34e62eefd5e1 with identifier: ZZ34330 to the API
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ34330>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-28T16:25:38Z',
 'fuel_type': 'petrol',
 'id': '46fdcc49-3adb-535b-9e21-34e62eefd5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ34330',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 47670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ34330%27 HTTP/1.1" 200 None
2026-01-28 10:09:10 [auto1.it] INFO: Saving data for ZZ34330: {'auction_closing_time': 1769617538.0, 'created_time': 1769076230.371264, 'last_price_update_time': 1769594950.959354}
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ34330') HTTP/1.1" 204 0
2026-01-28 10:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:13 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: AP68870
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP68870%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for AP68870: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: GN74198
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74198%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for GN74198: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: XW74392
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for XW74392: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: GT07178
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT07178%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for GT07178: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: RW40398
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for RW40398: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: NK32002
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for NK32002: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: CH15659
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15659%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for CH15659: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: JR02113
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02113%27 HTTP/1.1" 200 None
2026-01-28 10:09:13 [auto1.it] INFO: Scrape type for JR02113: 0
2026-01-28 10:09:13 [auto1.it] INFO: Found listing with ID: RM66243
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66243%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for RM66243: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: FU48439
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU48439%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for FU48439: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZP37659
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZP37659: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: LY72233
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for LY72233: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: JJ36044
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ36044%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for JJ36044: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZG56309
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG56309%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZG56309: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZX15052
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX15052%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZX15052: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: AT20318
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for AT20318: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: RF35677
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF35677%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for RF35677: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: JR34638
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR34638%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for JR34638: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZK76849
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZK76849: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: RL06920
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for RL06920: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: EJ52665
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for EJ52665: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: SL26814
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for SL26814: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: RX14856
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for RX14856: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: FS37784
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for FS37784: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: GJ05057
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ05057%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for GJ05057: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: AF06947
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for AF06947: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: YJ87014
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87014%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for YJ87014: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: XF61996
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for XF61996: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: WM15511
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM15511%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for WM15511: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: RV79194
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV79194%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for RV79194: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: AC98886
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC98886%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for AC98886: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: BW20992
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW20992%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for BW20992: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: NC36424
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC36424%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for NC36424: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: BH18095
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH18095%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for BH18095: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: KU22756
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU22756%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for KU22756: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZN56285
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN56285%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZN56285: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: ZA57365
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA57365%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for ZA57365: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: KE54965
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for KE54965: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: BP00644
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP00644%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for BP00644: 0
2026-01-28 10:09:14 [auto1.it] INFO: Found listing with ID: KR12343
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR12343%27 HTTP/1.1" 200 None
2026-01-28 10:09:14 [auto1.it] INFO: Scrape type for KR12343: 0
2026-01-28 10:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK19049> (referer: https://www.auto1.com/v1/car-details-view/AK19049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6312470-c88e-5c93-8108-b9426911df6c with identifier: AK19049
2026-01-28 10:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6312470-c88e-5c93-8108-b9426911df6c with scrape type 1
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d6312470-c88e-5c93-8108-b9426911df6c
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_5689f641e9f2acaa0805c52b2bb56795.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_5689f641e9f2acaa0805c52b2bb56795.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_96c8c965fbdad5dad2b6a8d90bfe2ce6.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_96c8c965fbdad5dad2b6a8d90bfe2ce6.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_2caf5b2a8f8b3ac7320ef7c3f45e3464.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2caf5b2a8f8b3ac7320ef7c3f45e3464.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_d05bddef3c5322832b676f6697df0aba.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_d05bddef3c5322832b676f6697df0aba.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_1e234bcf9ab153454a63599cdebd2be4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_1e234bcf9ab153454a63599cdebd2be4.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_f2b7c40096cfe63373c9b39531405836.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_f2b7c40096cfe63373c9b39531405836.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_aa980348daff42e2ffd6fcacab78b138.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_aa980348daff42e2ffd6fcacab78b138.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_0005f74136a61224e04172f170fafc7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_0005f74136a61224e04172f170fafc7d.jpg already downloaded
2026-01-28 10:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_3907d888d4476109f5f2c89e4c0d3da0.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_3907d888d4476109f5f2c89e4c0d3da0.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_23eef57b8db0b1431dc7e1e1cc0fff7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_23eef57b8db0b1431dc7e1e1cc0fff7b.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_bdb06d1cb33b9126147e2eea1751c54f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bdb06d1cb33b9126147e2eea1751c54f.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_bd29cb7d02ea832137cd564c00ade448.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bd29cb7d02ea832137cd564c00ade448.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_26cf7fcc029c737d2606ca765ca0b183.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_26cf7fcc029c737d2606ca765ca0b183.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_2a7193d05f2ef2104f7dce89a38ca4f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2a7193d05f2ef2104f7dce89a38ca4f3.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_60d04361cbcba539b1fa4e796a87d6aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_60d04361cbcba539b1fa4e796a87d6aa.jpg already downloaded
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F89%252F6189f3c9092b1a6790fac42a81f1fef5%252Fpa%252FAK19049_4406c1919046ee348e06232cff6e0cef.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_4406c1919046ee348e06232cff6e0cef.jpg already downloaded
2026-01-28 10:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d6312470-c88e-5c93-8108-b9426911df6c, identifier: AK19049
2026-01-28 10:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d6312470-c88e-5c93-8108-b9426911df6c with identifier: AK19049
2026-01-28 10:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d6312470-c88e-5c93-8108-b9426911df6c with identifier: AK19049
2026-01-28 10:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d6312470-c88e-5c93-8108-b9426911df6c with identifier: AK19049 to the API
2026-01-28 10:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK19049>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:18:29Z',
 'fuel_type': 'diesel',
 'id': 'd6312470-c88e-5c93-8108-b9426911df6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK19049',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 72384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_5689f641e9f2acaa0805c52b2bb56795.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_96c8c965fbdad5dad2b6a8d90bfe2ce6.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2caf5b2a8f8b3ac7320ef7c3f45e3464.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_d05bddef3c5322832b676f6697df0aba.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_1e234bcf9ab153454a63599cdebd2be4.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_f2b7c40096cfe63373c9b39531405836.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_aa980348daff42e2ffd6fcacab78b138.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_0005f74136a61224e04172f170fafc7d.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_3907d888d4476109f5f2c89e4c0d3da0.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_23eef57b8db0b1431dc7e1e1cc0fff7b.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bdb06d1cb33b9126147e2eea1751c54f.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bd29cb7d02ea832137cd564c00ade448.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_26cf7fcc029c737d2606ca765ca0b183.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2a7193d05f2ef2104f7dce89a38ca4f3.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_60d04361cbcba539b1fa4e796a87d6aa.jpg',
                'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_4406c1919046ee348e06232cff6e0cef.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44007,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_5689f641e9f2acaa0805c52b2bb56795.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44007,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_96c8c965fbdad5dad2b6a8d90bfe2ce6.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46863,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2caf5b2a8f8b3ac7320ef7c3f45e3464.jpg',
             'Width': 563},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44383,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_d05bddef3c5322832b676f6697df0aba.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44383,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_1e234bcf9ab153454a63599cdebd2be4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46759,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_f2b7c40096cfe63373c9b39531405836.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44007,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_aa980348daff42e2ffd6fcacab78b138.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52318,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_0005f74136a61224e04172f170fafc7d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42920,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_3907d888d4476109f5f2c89e4c0d3da0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39995,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_23eef57b8db0b1431dc7e1e1cc0fff7b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40259,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bdb06d1cb33b9126147e2eea1751c54f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22425,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_bd29cb7d02ea832137cd564c00ade448.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43986,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_26cf7fcc029c737d2606ca765ca0b183.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35544,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_2a7193d05f2ef2104f7dce89a38ca4f3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_60d04361cbcba539b1fa4e796a87d6aa.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6312470-c88e-5c93-8108-b9426911df6c/d6312470-c88e-5c93-8108-b9426911df6c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 17272,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img61/89/6189f3c9092b1a6790fac42a81f1fef5/pa/AK19049_4406c1919046ee348e06232cff6e0cef.jpg',
             'Width': 360}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 30 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK19049%27 HTTP/1.1" 200 None
2026-01-28 10:09:18 [auto1.it] INFO: Saving data for AK19049: {'auction_closing_time': 1769703509.0, 'created_time': 1769594958.745544, 'last_price_update_time': 1769594958.745555}
2026-01-28 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK19049') HTTP/1.1" 204 0
2026-01-28 10:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK07610> (referer: https://www.auto1.com/v1/car-details-view/VK07610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2026-01-28 10:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09a8b28-d492-5241-be90-b61ead680804 with scrape type 2
2026-01-28 10:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09a8b28-d492-5241-be90-b61ead680804 with scrape type 2
2026-01-28 10:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a09a8b28-d492-5241-be90-b61ead680804, identifier: VK07610
2026-01-28 10:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2026-01-28 10:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2026-01-28 10:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2026-01-28 10:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a09a8b28-d492-5241-be90-b61ead680804 spider: auto1.it
2026-01-28 10:09:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a09a8b28-d492-5241-be90-b61ead680804 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:58:37Z',
 'fuel_type': 'diesel',
 'id': 'a09a8b28-d492-5241-be90-b61ead680804',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK07610',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 78575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2019}
2026-01-28 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2026-01-28 10:09:26 [auto1.it] INFO: Saving data for VK07610: {'auction_closing_time': 1769705917.0, 'created_time': 1768471444.54106, 'last_price_update_time': 1769594966.549474}
2026-01-28 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK07610') HTTP/1.1" 204 0
2026-01-28 10:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD53703> (referer: https://www.auto1.com/v1/car-details-view/UD53703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01f57ad3-cd76-5fb9-b90c-2f33c8000777 with identifier: UD53703
2026-01-28 10:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01f57ad3-cd76-5fb9-b90c-2f33c8000777 with scrape type 1
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 01f57ad3-cd76-5fb9-b90c-2f33c8000777
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_a143664837490a80c7184cbf153cd37c.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_a143664837490a80c7184cbf153cd37c.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_836fe019697402d2dae99f8ab3fc881b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_836fe019697402d2dae99f8ab3fc881b.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_387d866a920ef58df8d3c12a6a069f31.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_387d866a920ef58df8d3c12a6a069f31.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_3abe7ad33674a64788bba70dc2c0536a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_3abe7ad33674a64788bba70dc2c0536a.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_9166795bd1c0ccc74274862b775cf5f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_9166795bd1c0ccc74274862b775cf5f9.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_475ea12d9ca3a0b23de47e6f294a2677.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_475ea12d9ca3a0b23de47e6f294a2677.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_92db1e8d08bbee0f74865ca7fc53a934.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_92db1e8d08bbee0f74865ca7fc53a934.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_8b94d5257653221dab1e3b1d2ed4e804.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_8b94d5257653221dab1e3b1d2ed4e804.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_941cf787691def76625087e7c3071bee.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_941cf787691def76625087e7c3071bee.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_689020379be36b8c2714947a3ed9dc76.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_689020379be36b8c2714947a3ed9dc76.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_90980aa4a2555e9036fabf9bf59a3ebe.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_90980aa4a2555e9036fabf9bf59a3ebe.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_620e585c7940b2f2eea6548b471984d7.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_620e585c7940b2f2eea6548b471984d7.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_305cd6775f2a2918379503e860f8407a.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_305cd6775f2a2918379503e860f8407a.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_2b45d0b9cca970d26e78ebd431b88604.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_2b45d0b9cca970d26e78ebd431b88604.jpg already downloaded
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F32%252Fea3202010008a0ffc827fc94e27dc1f9%252Fpa%252FUD53703_b4f16ed87f184a6c37b7bcbf44f2ef7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_b4f16ed87f184a6c37b7bcbf44f2ef7d.jpg already downloaded
2026-01-28 10:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01f57ad3-cd76-5fb9-b90c-2f33c8000777, identifier: UD53703
2026-01-28 10:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01f57ad3-cd76-5fb9-b90c-2f33c8000777 with identifier: UD53703
2026-01-28 10:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01f57ad3-cd76-5fb9-b90c-2f33c8000777 with identifier: UD53703
2026-01-28 10:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01f57ad3-cd76-5fb9-b90c-2f33c8000777 with identifier: UD53703 to the API
2026-01-28 10:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD53703>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:43:59Z',
 'fuel_type': 'diesel',
 'id': '01f57ad3-cd76-5fb9-b90c-2f33c8000777',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD53703',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 68613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_a143664837490a80c7184cbf153cd37c.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_836fe019697402d2dae99f8ab3fc881b.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_387d866a920ef58df8d3c12a6a069f31.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_3abe7ad33674a64788bba70dc2c0536a.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_9166795bd1c0ccc74274862b775cf5f9.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_475ea12d9ca3a0b23de47e6f294a2677.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_92db1e8d08bbee0f74865ca7fc53a934.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_8b94d5257653221dab1e3b1d2ed4e804.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_941cf787691def76625087e7c3071bee.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_689020379be36b8c2714947a3ed9dc76.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_90980aa4a2555e9036fabf9bf59a3ebe.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_620e585c7940b2f2eea6548b471984d7.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_305cd6775f2a2918379503e860f8407a.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_2b45d0b9cca970d26e78ebd431b88604.jpg',
                'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_b4f16ed87f184a6c37b7bcbf44f2ef7d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_a143664837490a80c7184cbf153cd37c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_836fe019697402d2dae99f8ab3fc881b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_387d866a920ef58df8d3c12a6a069f31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_3abe7ad33674a64788bba70dc2c0536a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_9166795bd1c0ccc74274862b775cf5f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_475ea12d9ca3a0b23de47e6f294a2677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_92db1e8d08bbee0f74865ca7fc53a934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_8b94d5257653221dab1e3b1d2ed4e804.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_941cf787691def76625087e7c3071bee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_689020379be36b8c2714947a3ed9dc76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_90980aa4a2555e9036fabf9bf59a3ebe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_620e585c7940b2f2eea6548b471984d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_305cd6775f2a2918379503e860f8407a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_2b45d0b9cca970d26e78ebd431b88604.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01f57ad3-cd76-5fb9-b90c-2f33c8000777/01f57ad3-cd76-5fb9-b90c-2f33c8000777_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/32/ea3202010008a0ffc827fc94e27dc1f9/pa/UD53703_b4f16ed87f184a6c37b7bcbf44f2ef7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-28 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD53703%27 HTTP/1.1" 200 None
2026-01-28 10:09:37 [auto1.it] INFO: Saving data for UD53703: {'auction_closing_time': 1769705039.0, 'created_time': 1769594977.748834, 'last_price_update_time': 1769594977.748849}
2026-01-28 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD53703') HTTP/1.1" 204 0
2026-01-28 10:09:43 [scrapy.extensions.logstats] INFO: Crawled 318 pages (at 28 pages/min), scraped 114 items (at 17 items/min)
2026-01-28 10:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:10:25 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: NM38508
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM38508%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for NM38508: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: EN85352
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for EN85352: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: XX93574
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for XX93574: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: RW00957
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW00957%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for RW00957: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: BS78089
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS78089%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for BS78089: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: YM48404
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM48404%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for YM48404: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: BU52246
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU52246%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for BU52246: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: HA91981
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA91981%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for HA91981: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: HW92589
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW92589%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for HW92589: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: UU46505
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU46505%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for UU46505: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: WV97974
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV97974%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for WV97974: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: HP27763
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP27763%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for HP27763: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: EA68503
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for EA68503: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: XX71668
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX71668%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for XX71668: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: LV34677
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV34677%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for LV34677: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: DL90680
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL90680%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for DL90680: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: RU40979
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU40979%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for RU40979: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: KJ64767
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64767%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for KJ64767: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: ZA06304
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: VW50563
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW50563%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for VW50563: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: DG14106
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG14106%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for DG14106: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: CE44712
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE44712%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for CE44712: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: SG47453
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG47453%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for SG47453: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: LU29351
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU29351%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for LU29351: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: CT48603
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT48603%27 HTTP/1.1" 200 None
2026-01-28 10:10:25 [auto1.it] INFO: Scrape type for CT48603: 0
2026-01-28 10:10:25 [auto1.it] INFO: Found listing with ID: FH85021
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH85021%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for FH85021: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: ZL90358
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL90358%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for ZL90358: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: NG60462
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG60462%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for NG60462: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: UR07815
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR07815%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for UR07815: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: YM26268
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM26268%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for YM26268: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: HW64559
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for HW64559: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: KK65649
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK65649%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for KK65649: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: JT18745
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT18745%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for JT18745: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: XB39028
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for XB39028: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: DJ35523
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ35523%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for DJ35523: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: GY05920
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for GY05920: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: SX16297
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX16297%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for SX16297: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: PN13750
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN13750%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for PN13750: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: AH71898
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for AH71898: 0
2026-01-28 10:10:26 [auto1.it] INFO: Found listing with ID: YK03588
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2026-01-28 10:10:26 [auto1.it] INFO: Scrape type for YK03588: 0
2026-01-28 10:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:10:43 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 1 pages/min), scraped 114 items (at 0 items/min)
2026-01-28 10:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:10:44 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: MX37166
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX37166%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for MX37166: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: GY37830
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for GY37830: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: TF80780
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for TF80780: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: ZY33517
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33517%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for ZY33517: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: YC62647
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for YC62647: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: ZP66012
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66012%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for ZP66012: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: GA88352
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA88352%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for GA88352: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: EX13781
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX13781%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for EX13781: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: BE02866
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE02866%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for BE02866: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: UD44278
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD44278%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for UD44278: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: SE73703
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for SE73703: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: FD29488
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29488%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for FD29488: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: LX50050
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for LX50050: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: WA99422
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA99422%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for WA99422: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: VU47958
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for VU47958: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: PW60700
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW60700%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for PW60700: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: XL18907
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for XL18907: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: RW28889
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for RW28889: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: XH67848
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH67848%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for XH67848: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: AU30700
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for AU30700: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: DC75270
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for DC75270: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: GL72110
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for GL72110: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: VJ46302
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for VJ46302: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: BK29773
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK29773%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for BK29773: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: WR93910
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR93910%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for WR93910: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: NF65001
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF65001%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for NF65001: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: HW19306
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW19306%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for HW19306: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: WZ98003
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ98003%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for WZ98003: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: KR39875
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR39875%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for KR39875: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: DS86175
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS86175%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for DS86175: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: KE23075
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE23075%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for KE23075: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: AP06921
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP06921%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for AP06921: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: FR60172
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR60172%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for FR60172: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: UY53299
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY53299%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for UY53299: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: MG24546
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG24546%27 HTTP/1.1" 200 None
2026-01-28 10:10:44 [auto1.it] INFO: Scrape type for MG24546: 0
2026-01-28 10:10:44 [auto1.it] INFO: Found listing with ID: TC41624
2026-01-28 10:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC41624%27 HTTP/1.1" 200 None
2026-01-28 10:10:45 [auto1.it] INFO: Scrape type for TC41624: 0
2026-01-28 10:10:45 [auto1.it] INFO: Found listing with ID: EN89952
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN89952%27 HTTP/1.1" 200 None
2026-01-28 10:10:45 [auto1.it] INFO: Scrape type for EN89952: 0
2026-01-28 10:10:45 [auto1.it] INFO: Found listing with ID: LC41614
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41614%27 HTTP/1.1" 200 None
2026-01-28 10:10:45 [auto1.it] INFO: Scrape type for LC41614: 0
2026-01-28 10:10:45 [auto1.it] INFO: Found listing with ID: NT83808
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT83808%27 HTTP/1.1" 200 None
2026-01-28 10:10:45 [auto1.it] INFO: Scrape type for NT83808: 0
2026-01-28 10:10:45 [auto1.it] INFO: Found listing with ID: XX48946
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX48946%27 HTTP/1.1" 200 None
2026-01-28 10:10:45 [auto1.it] INFO: Scrape type for XX48946: 0
2026-01-28 10:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:10:46 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: SY35335
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY35335%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for SY35335: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: NR19690
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19690%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for NR19690: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: HF33794
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF33794%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for HF33794: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: PW04217
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW04217%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for PW04217: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: JZ99891
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ99891%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for JZ99891: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: SN76439
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for SN76439: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: LE26048
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE26048%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for LE26048: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: RZ37041
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ37041%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for RZ37041: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: VJ87382
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for VJ87382: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: WZ58856
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for WZ58856: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: FS57712
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS57712%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for FS57712: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: JB07830
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB07830%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for JB07830: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: GY55011
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for GY55011: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: MC45094
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC45094%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for MC45094: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: CJ96315
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ96315%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for CJ96315: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: GW95975
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for GW95975: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: UH26467
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH26467%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for UH26467: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: DM37536
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM37536%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for DM37536: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: KG82335
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG82335%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for KG82335: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: FD77892
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD77892%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for FD77892: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: VS63491
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63491%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for VS63491: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: BP11970
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP11970%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for BP11970: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: CM86326
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM86326%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for CM86326: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: MB19199
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB19199%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for MB19199: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: VK27211
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK27211%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for VK27211: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: DH39383
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH39383%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for DH39383: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: HT61249
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT61249%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for HT61249: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: DP80955
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP80955%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for DP80955: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: TB86864
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB86864%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for TB86864: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: GC68845
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68845%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for GC68845: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: ZN65600
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN65600%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for ZN65600: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: KU06589
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU06589%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for KU06589: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: AL67393
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL67393%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for AL67393: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: LT93691
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT93691%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for LT93691: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: FR59611
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR59611%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for FR59611: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: EZ39176
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ39176%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for EZ39176: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: AS00040
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS00040%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for AS00040: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: BD06360
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD06360%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for BD06360: 0
2026-01-28 10:10:46 [auto1.it] INFO: Found listing with ID: BY77891
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-01-28 10:10:46 [auto1.it] INFO: Scrape type for BY77891: 0
2026-01-28 10:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:10:53 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: FD61613
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD61613%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for FD61613: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: YA41341
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA41341%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for YA41341: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: SW85774
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW85774%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for SW85774: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: LB25725
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25725%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for LB25725: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: WY47347
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for WY47347: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: RD80125
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD80125%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for RD80125: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: UU64650
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64650%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for UU64650: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: PH37859
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH37859%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for PH37859: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: GN66049
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN66049%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for GN66049: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: YB28546
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB28546%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for YB28546: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: LX29596
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX29596%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for LX29596: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: UZ59639
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ59639%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for UZ59639: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: TP54154
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP54154%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for TP54154: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: TJ53755
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ53755%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for TJ53755: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: YZ33678
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ33678%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for YZ33678: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: CB54413
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB54413%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for CB54413: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: BW17838
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW17838%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for BW17838: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: FM65684
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM65684%27 HTTP/1.1" 200 None
2026-01-28 10:10:53 [auto1.it] INFO: Scrape type for FM65684: 0
2026-01-28 10:10:53 [auto1.it] INFO: Found listing with ID: BL99531
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL99531%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for BL99531: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: TP30511
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30511%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for TP30511: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: CN56485
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN56485%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for CN56485: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: ES13575
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES13575%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for ES13575: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: XG77213
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG77213%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for XG77213: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: CW51331
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW51331%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for CW51331: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: JP77567
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP77567%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for JP77567: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: UT25383
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT25383%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for UT25383: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: MD11122
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD11122%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for MD11122: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: TP56886
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP56886%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for TP56886: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: WT86652
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT86652%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for WT86652: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: HX56928
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX56928%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for HX56928: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: TS00967
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS00967%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for TS00967: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: SW68583
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW68583%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for SW68583: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: NB38092
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB38092%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for NB38092: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: JG91942
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91942%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for JG91942: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: NN35046
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN35046%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for NN35046: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: GX74312
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX74312%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for GX74312: 0
2026-01-28 10:10:54 [auto1.it] INFO: Found listing with ID: AD68193
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD68193%27 HTTP/1.1" 200 None
2026-01-28 10:10:54 [auto1.it] INFO: Scrape type for AD68193: 0
2026-01-28 10:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:10:55 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: NL34608
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL34608%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for NL34608: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: SK32602
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK32602%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for SK32602: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: LD62030
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD62030%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for LD62030: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: XF74910
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF74910%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for XF74910: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: XJ76897
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ76897%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for XJ76897: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: LB98702
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB98702%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for LB98702: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: RJ83517
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ83517%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for RJ83517: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: KN31697
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN31697%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for KN31697: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: FF86857
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for FF86857: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: SA07653
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA07653%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for SA07653: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: XH51228
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH51228%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for XH51228: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: YW17704
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW17704%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for YW17704: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: UN61928
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN61928%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for UN61928: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: SC91268
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91268%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for SC91268: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: WT09600
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for WT09600: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: BP77320
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP77320%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for BP77320: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: PP34407
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP34407%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for PP34407: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: SD18142
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18142%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for SD18142: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: HD77272
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD77272%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for HD77272: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: AH34632
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH34632%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for AH34632: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: BP48595
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP48595%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for BP48595: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: FA52335
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA52335%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for FA52335: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: HW78995
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW78995%27 HTTP/1.1" 200 None
2026-01-28 10:10:55 [auto1.it] INFO: Scrape type for HW78995: 0
2026-01-28 10:10:55 [auto1.it] INFO: Found listing with ID: XP01940
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP01940%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for XP01940: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: XM03029
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for XM03029: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: NK14048
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK14048%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for NK14048: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: JS30214
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS30214%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for JS30214: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: DP76328
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for DP76328: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: VT99729
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT99729%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for VT99729: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: JX72433
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for JX72433: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: HE18961
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE18961%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for HE18961: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: SX06852
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX06852%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for SX06852: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: BD24207
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD24207%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for BD24207: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: EN91628
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN91628%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for EN91628: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: JD91728
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD91728%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for JD91728: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: BN48518
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for BN48518: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: NL17147
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL17147%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for NL17147: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: DC19441
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19441%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for DC19441: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: ZZ39119
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39119%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for ZZ39119: 0
2026-01-28 10:10:56 [auto1.it] INFO: Found listing with ID: AD90482
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD90482%27 HTTP/1.1" 200 None
2026-01-28 10:10:56 [auto1.it] INFO: Scrape type for AD90482: 0
2026-01-28 10:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:10:57 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.878(s), this was the 1st time calling it.
2026-01-28 10:10:57 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.969576049322111 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:10:57 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.204(s), this was the 1st time calling it.
2026-01-28 10:10:57 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.634078369857395 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-01-28 10:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:11:04 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: BL38298
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL38298%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for BL38298: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: CE73370
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE73370%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for CE73370: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: SX21988
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21988%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for SX21988: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: HB24915
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB24915%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for HB24915: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: XL62613
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL62613%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for XL62613: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: HZ16886
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ16886%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for HZ16886: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: RR79285
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79285%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for RR79285: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: FB32798
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB32798%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for FB32798: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: FT64477
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT64477%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for FT64477: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: MU64340
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for MU64340: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: TT43912
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for TT43912: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: GR20930
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20930%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for GR20930: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: NC33689
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC33689%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for NC33689: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: LT39464
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT39464%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for LT39464: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: UM24517
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM24517%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for UM24517: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: VJ83989
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ83989%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for VJ83989: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: DZ39731
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ39731%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for DZ39731: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: FX76200
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX76200%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for FX76200: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: GX60446
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX60446%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for GX60446: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: SX30398
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX30398%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for SX30398: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: NV14879
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14879%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for NV14879: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: BB04771
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB04771%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for BB04771: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: HM97674
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-01-28 10:11:04 [auto1.it] INFO: Scrape type for HM97674: 0
2026-01-28 10:11:04 [auto1.it] INFO: Found listing with ID: UF13738
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for UF13738: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: MJ74552
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ74552%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for MJ74552: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: YB80844
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB80844%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for YB80844: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: JK71326
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK71326%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for JK71326: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: KW94897
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW94897%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for KW94897: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: FL81040
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL81040%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for FL81040: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: AZ36136
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ36136%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for AZ36136: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: XR33042
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR33042%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for XR33042: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: LM64931
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM64931%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for LM64931: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: EB83930
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB83930%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for EB83930: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: AK97065
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK97065%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for AK97065: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: ZP16966
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP16966%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for ZP16966: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: GM98091
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for GM98091: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: SB54869
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB54869%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for SB54869: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: YU15778
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU15778%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for YU15778: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: GW19210
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW19210%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for GW19210: 0
2026-01-28 10:11:05 [auto1.it] INFO: Found listing with ID: HT84614
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT84614%27 HTTP/1.1" 200 None
2026-01-28 10:11:05 [auto1.it] INFO: Scrape type for HT84614: 0
2026-01-28 10:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC19366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC19366> (referer: https://www.auto1.com/v1/car-details-view/SC19366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7288926-61db-59d1-97a7-dbe4847f7dcd with identifier: SC19366
2026-01-28 10:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7288926-61db-59d1-97a7-dbe4847f7dcd with scrape type 1
2026-01-28 10:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a7288926-61db-59d1-97a7-dbe4847f7dcd
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_8e85ca3dae42c8ba233ccaf38d6f18c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_8e85ca3dae42c8ba233ccaf38d6f18c4.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_9715be17945741126d09b628cc382850.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_9715be17945741126d09b628cc382850.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_706ac1102469e64f1fee079e75ab79cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_706ac1102469e64f1fee079e75ab79cb.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_b91c28d96332f608131ca2cc638eacb3.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_b91c28d96332f608131ca2cc638eacb3.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_04cbe38e2b6777a4de29ff7d08c9644b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_04cbe38e2b6777a4de29ff7d08c9644b.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_1dc948462bd1d256b820eef10ee0ab04.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1dc948462bd1d256b820eef10ee0ab04.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_835c8ec476a90ca838e1c828321a585f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_835c8ec476a90ca838e1c828321a585f.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_1813b54c33ad968ec3734126263f0efb.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1813b54c33ad968ec3734126263f0efb.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_a352713e0b70bbb8b10ddc1fc8726442.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_a352713e0b70bbb8b10ddc1fc8726442.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_059dc0c8879c1b88aacff96319733778.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_059dc0c8879c1b88aacff96319733778.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_f6587bc657fe8bfb3b0776e7f45e6571.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_f6587bc657fe8bfb3b0776e7f45e6571.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_df121704a0f0fd64ad4edbd3354ba393.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_df121704a0f0fd64ad4edbd3354ba393.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_58299887e3c22f68415080aa8c009118.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_58299887e3c22f68415080aa8c009118.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_129686b4d475c5500174412c842b9546.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_129686b4d475c5500174412c842b9546.jpg already downloaded
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F40%252F384082dd1dd84e333e8a294d243e6bfd%252Fpa%252FSC19366_6cf36e9a736c5da752dc7fbdd08beb18.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_6cf36e9a736c5da752dc7fbdd08beb18.jpg already downloaded
2026-01-28 10:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7288926-61db-59d1-97a7-dbe4847f7dcd, identifier: SC19366
2026-01-28 10:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7288926-61db-59d1-97a7-dbe4847f7dcd with identifier: SC19366
2026-01-28 10:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7288926-61db-59d1-97a7-dbe4847f7dcd with identifier: SC19366
2026-01-28 10:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7288926-61db-59d1-97a7-dbe4847f7dcd with identifier: SC19366 to the API
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC19366>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:51:17Z',
 'fuel_type': 'petrol',
 'id': 'a7288926-61db-59d1-97a7-dbe4847f7dcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC19366',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 35382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_8e85ca3dae42c8ba233ccaf38d6f18c4.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_9715be17945741126d09b628cc382850.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_706ac1102469e64f1fee079e75ab79cb.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_b91c28d96332f608131ca2cc638eacb3.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_04cbe38e2b6777a4de29ff7d08c9644b.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1dc948462bd1d256b820eef10ee0ab04.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_835c8ec476a90ca838e1c828321a585f.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1813b54c33ad968ec3734126263f0efb.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_a352713e0b70bbb8b10ddc1fc8726442.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_059dc0c8879c1b88aacff96319733778.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_f6587bc657fe8bfb3b0776e7f45e6571.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_df121704a0f0fd64ad4edbd3354ba393.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_58299887e3c22f68415080aa8c009118.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_129686b4d475c5500174412c842b9546.jpg',
                'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_6cf36e9a736c5da752dc7fbdd08beb18.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33190,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_8e85ca3dae42c8ba233ccaf38d6f18c4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33190,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_9715be17945741126d09b628cc382850.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35297,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_706ac1102469e64f1fee079e75ab79cb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33612,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_b91c28d96332f608131ca2cc638eacb3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33612,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_04cbe38e2b6777a4de29ff7d08c9644b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33199,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1dc948462bd1d256b820eef10ee0ab04.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33190,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_835c8ec476a90ca838e1c828321a585f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39576,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_1813b54c33ad968ec3734126263f0efb.jpg',
             'Width': 565},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31331,
             'Height': 455,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_a352713e0b70bbb8b10ddc1fc8726442.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40303,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_059dc0c8879c1b88aacff96319733778.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40567,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_f6587bc657fe8bfb3b0776e7f45e6571.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20063,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_df121704a0f0fd64ad4edbd3354ba393.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37400,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_58299887e3c22f68415080aa8c009118.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_129686b4d475c5500174412c842b9546.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7288926-61db-59d1-97a7-dbe4847f7dcd/a7288926-61db-59d1-97a7-dbe4847f7dcd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/40/384082dd1dd84e333e8a294d243e6bfd/pa/SC19366_6cf36e9a736c5da752dc7fbdd08beb18.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC19366%27 HTTP/1.1" 200 None
2026-01-28 10:11:13 [auto1.it] INFO: Saving data for SC19366: {'auction_closing_time': 1769705477.0, 'created_time': 1769595073.23684, 'last_price_update_time': 1769595073.236853}
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC19366') HTTP/1.1" 204 0
2026-01-28 10:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:11:21 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: HG59562
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG59562%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for HG59562: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: RZ04126
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ04126%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for RZ04126: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: WV64596
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for WV64596: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: PJ38306
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ38306%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for PJ38306: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: PM64669
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM64669%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for PM64669: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: AV95910
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV95910%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for AV95910: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: UW96033
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for UW96033: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: GL50499
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL50499%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for GL50499: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: RZ31448
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31448%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for RZ31448: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: FW48614
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW48614%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for FW48614: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: LS33015
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS33015%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for LS33015: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: AV53381
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53381%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for AV53381: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: LL61662
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL61662%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for LL61662: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: PT59724
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT59724%27 HTTP/1.1" 200 None
2026-01-28 10:11:21 [auto1.it] INFO: Scrape type for PT59724: 0
2026-01-28 10:11:21 [auto1.it] INFO: Found listing with ID: ZC30818
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC30818%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for ZC30818: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: GC79469
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC79469%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for GC79469: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: MV48827
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48827%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for MV48827: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: AK95829
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK95829%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for AK95829: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: TM67998
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM67998%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for TM67998: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: SY04833
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY04833%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for SY04833: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: JA19624
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA19624%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for JA19624: 0
2026-01-28 10:11:22 [auto1.it] INFO: Found listing with ID: UA07437
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA07437%27 HTTP/1.1" 200 None
2026-01-28 10:11:22 [auto1.it] INFO: Scrape type for UA07437: 0
2026-01-28 10:11:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 10:11:43 [scrapy.extensions.logstats] INFO: Crawled 327 pages (at 8 pages/min), scraped 115 items (at 1 items/min)
2026-01-28 10:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:11:58 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 10:12:43 [scrapy.extensions.logstats] INFO: Crawled 328 pages (at 1 pages/min), scraped 115 items (at 0 items/min)
2026-01-28 10:13:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.094(s), this was the 2nd time calling it.
2026-01-28 10:13:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.945748690458708 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-01-28 10:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-01-28 10:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX41377> (referer: https://www.auto1.com/v1/car-details-view/AX41377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 10:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7 with identifier: AX41377
2026-01-28 10:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7 with scrape type 1
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_ef813ce33dfa9ef8379a7a47123525e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_ef813ce33dfa9ef8379a7a47123525e5.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_20498ba3ae44aed705f41ecec781129f.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_20498ba3ae44aed705f41ecec781129f.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_5c175dedb8cf875ff5462d8767067ef2.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_5c175dedb8cf875ff5462d8767067ef2.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_77e554c0737ccff89788a8e1b50dadfa.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_77e554c0737ccff89788a8e1b50dadfa.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_9206d051a613bf3363297cdcddf31054.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_9206d051a613bf3363297cdcddf31054.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_8a8705d276450b739781aa626aadb75e.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_8a8705d276450b739781aa626aadb75e.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_984abc44db8bbeb7c257e505b3133757.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_984abc44db8bbeb7c257e505b3133757.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_029038221545576ea897cc61f8a9276b.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_029038221545576ea897cc61f8a9276b.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_e557d80ed878dc298edcdf7681281011.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_e557d80ed878dc298edcdf7681281011.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_6864b88fe473b3b9742e4a176b413894.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_6864b88fe473b3b9742e4a176b413894.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_198e007893f375d2320769101a5f3723.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_198e007893f375d2320769101a5f3723.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_fa85047668b92f892f26884751a1cd64.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_fa85047668b92f892f26884751a1cd64.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_a7eb61b1a43dd9fdae6df6db60199656.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_a7eb61b1a43dd9fdae6df6db60199656.jpg already downloaded
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F5f%252F7e5fe1e2d9e6810c2fbda92a2373052c%252Fpa%252FAX41377_56a08a20788f2c381ac3555e094712b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 10:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_56a08a20788f2c381ac3555e094712b5.jpg already downloaded
2026-01-28 10:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7, identifier: AX41377
2026-01-28 10:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7 with identifier: AX41377
2026-01-28 10:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7 with identifier: AX41377
2026-01-28 10:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46cfeb6c-ec01-54aa-9910-fc01a7cde5e7 with identifier: AX41377 to the API
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 10:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AX41377>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:10:15Z',
 'fuel_type': 'hybrid',
 'id': '46cfeb6c-ec01-54aa-9910-fc01a7cde5e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX41377',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 8203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_ef813ce33dfa9ef8379a7a47123525e5.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_20498ba3ae44aed705f41ecec781129f.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_5c175dedb8cf875ff5462d8767067ef2.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_77e554c0737ccff89788a8e1b50dadfa.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_9206d051a613bf3363297cdcddf31054.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_8a8705d276450b739781aa626aadb75e.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_984abc44db8bbeb7c257e505b3133757.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_029038221545576ea897cc61f8a9276b.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_e557d80ed878dc298edcdf7681281011.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_6864b88fe473b3b9742e4a176b413894.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_198e007893f375d2320769101a5f3723.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_fa85047668b92f892f26884751a1cd64.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_a7eb61b1a43dd9fdae6df6db60199656.jpg',
                'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_56a08a20788f2c381ac3555e094712b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_ef813ce33dfa9ef8379a7a47123525e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_20498ba3ae44aed705f41ecec781129f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_5c175dedb8cf875ff5462d8767067ef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_77e554c0737ccff89788a8e1b50dadfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_9206d051a613bf3363297cdcddf31054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_8a8705d276450b739781aa626aadb75e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_984abc44db8bbeb7c257e505b3133757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_029038221545576ea897cc61f8a9276b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_e557d80ed878dc298edcdf7681281011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_6864b88fe473b3b9742e4a176b413894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_198e007893f375d2320769101a5f3723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_fa85047668b92f892f26884751a1cd64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_a7eb61b1a43dd9fdae6df6db60199656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46cfeb6c-ec01-54aa-9910-fc01a7cde5e7/46cfeb6c-ec01-54aa-9910-fc01a7cde5e7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/5f/7e5fe1e2d9e6810c2fbda92a2373052c/pa/AX41377_56a08a20788f2c381ac3555e094712b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX41377%27 HTTP/1.1" 200 None
2026-01-28 10:13:26 [auto1.it] INFO: Saving data for AX41377: {'auction_closing_time': 1769703015.0, 'created_time': 1769595206.296615, 'last_price_update_time': 1769595206.296626}
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX41377') HTTP/1.1" 204 0
2026-01-28 10:13:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 10:13:26 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 10:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201769163206 HTTP/1.1" 200 None
2026-01-28 10:13:26 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (116 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_75_2026-01-28T10_00_04.jl
2026-01-28 10:13:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1169843,
 'downloader/request_count': 619,
 'downloader/request_method_count/GET': 596,
 'downloader/request_method_count/POST': 23,
 'downloader/response_bytes': 297615777,
 'downloader/response_count': 619,
 'downloader/response_status_count/200': 619,
 'dupefilter/filtered': 40,
 'elapsed_time_seconds': 762.737828,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 10, 13, 26, 535943, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 36,
 'item_dropped_reasons_count/DropItem': 36,
 'item_scraped_count': 116,
 'log_count/DEBUG': 7488,
 'log_count/INFO': 6230,
 'memusage/max': 201195520,
 'memusage/startup': 126832640,
 'photo_download_count': 290,
 'request_depth_max': 24,
 'response_received_count': 329,
 'scheduler/dequeued': 619,
 'scheduler/dequeued/memory': 619,
 'scheduler/enqueued': 619,
 'scheduler/enqueued/memory': 619,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 345,
 'scrapy-zyte-api/error_ratio': 0.0463768115942029,
 'scrapy-zyte-api/errors': 16,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 16,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.284580715501679,
 'scrapy-zyte-api/mean_response_seconds': 5.298628091404502,
 'scrapy-zyte-api/processed': 329,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 329,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 328,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 329,
 'scrapy-zyte-api/request_args/httpRequestBody': 23,
 'scrapy-zyte-api/request_args/httpRequestMethod': 23,
 'scrapy-zyte-api/request_args/httpResponseBody': 329,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 329,
 'scrapy-zyte-api/request_args/sessionContext': 329,
 'scrapy-zyte-api/request_args/url': 329,
 'scrapy-zyte-api/status_codes/0': 16,
 'scrapy-zyte-api/status_codes/200': 329,
 'scrapy-zyte-api/success': 329,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 10, 0, 43, 798115, tzinfo=datetime.timezone.utc)}
2026-01-28 10:13:26 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-28 10:13:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f39f5124210>
2026-01-28 10:13:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f39f4e854d0>
PROJECT (sourcing_v2), SPIDER (auto1.it)

Stats

Source

PROJECT (sourcing_v2), SPIDER (auto1.it)
