2025-12-05 10:01:17 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 10:01:17 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 10:01:17 [auto1.it] INFO: Starting spider auto1.it
2025-12-05 10:01:17 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 10:01:17 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 10:01:17 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 10:01:17 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 10:01:17 [scrapy.extensions.telnet] INFO: Telnet Password: a5de771bbb7e4f6c
2025-12-05 10:01:17 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 10:01:17 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_75_2025-12-05T10_00_05.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 10:01:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 10:01:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 10:01:17 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 10:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-05 10:01:17 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 10:01:17 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 10:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:01:17 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 10:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:17 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-05 10:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-05 10:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-05 10:01:17 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-05 10:01:17 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-05 10:01:17 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-05 10:01:17 [scrapy.core.engine] INFO: Spider opened
2025-12-05 10:01:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 10:01:17 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-05 10:01:17 [scrapy-playwright] INFO: Starting download handler
2025-12-05 10:01:17 [scrapy-playwright] INFO: Starting download handler
2025-12-05 10:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): publicsuffix.org:443
2025-12-05 10:01:24 [urllib3.connectionpool] DEBUG: https://publicsuffix.org:443 "GET /list/public_suffix_list.dat HTTP/1.1" 200 86417
2025-12-05 10:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2025-12-05 10:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2025-12-05 10:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2025-12-05 10:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2025-12-05 10:01:27 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: JX72433
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for JX72433: 1
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: HF58868
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF58868%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for HF58868: 2
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: VC15386
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC15386%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for VC15386: 1
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: GF05502
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05502%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for GF05502: 1
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: KC69548
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC69548%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for KC69548: 1
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: EL05291
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for EL05291: 2
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: FJ86916
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2025-12-05 10:01:27 [auto1.it] INFO: Scrape type for FJ86916: 1
2025-12-05 10:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:27 [auto1.it] INFO: Found listing with ID: EC73786
2025-12-05 10:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC73786%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for EC73786: 1
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: HM78467
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM78467%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for HM78467: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: XU79981
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU79981%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for XU79981: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: HW99743
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99743%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for HW99743: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: YH15526
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH15526%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for YH15526: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: ET69772
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET69772%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for ET69772: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: BG39549
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG39549%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for BG39549: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: KR69258
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR69258%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for KR69258: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: SH57663
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH57663%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for SH57663: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: ZZ38543
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ38543%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for ZZ38543: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: JS87755
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for JS87755: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: TR70280
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR70280%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for TR70280: 0
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: HB67400
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB67400%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for HB67400: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: BX65546
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX65546%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for BX65546: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: NH86693
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH86693%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for NH86693: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: FD37849
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD37849%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for FD37849: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: CE82522
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE82522%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for CE82522: 1
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: KT64449
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64449%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for KT64449: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: LU74910
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU74910%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for LU74910: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: BL82324
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL82324%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for BL82324: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: CB32763
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB32763%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for CB32763: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: LY90448
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY90448%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for LY90448: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: CW68051
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW68051%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for CW68051: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: ZC12313
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12313%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for ZC12313: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: KC62935
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC62935%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for KC62935: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: DF14227
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF14227%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for DF14227: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: YB92663
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for YB92663: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: AU30700
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for AU30700: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: WJ53867
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ53867%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for WJ53867: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: US74499
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US74499%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for US74499: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: JW97025
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW97025%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for JW97025: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: JA20233
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA20233%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for JA20233: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: LM82104
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM82104%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for LM82104: 2
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX72433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL05291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ86916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC15386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC69548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: JX72433
2025-12-05 10:01:28 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/JX72433/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: HF58868
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF58868%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for HF58868: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: VC15386
2025-12-05 10:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF58868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: GF05502
2025-12-05 10:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: KC69548
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: EL05291
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2025-12-05 10:01:28 [auto1.it] INFO: Scrape type for EL05291: 2
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: FJ86916
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: EC73786
2025-12-05 10:01:28 [auto1.it] INFO: Found listing with ID: HM78467
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM78467%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for HM78467: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: XU79981
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: HW99743
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: YH15526
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH15526%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for YH15526: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: ET69772
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: BG39549
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: KR69258
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: SH57663
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH57663%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for SH57663: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: ZZ38543
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: JS87755
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: TR70280
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR70280%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for TR70280: 0
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: HB67400
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: BX65546
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: NH86693
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: FD37849
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD37849%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for FD37849: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: CE82522
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: KT64449
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64449%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for KT64449: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: LU74910
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU74910%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for LU74910: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: BL82324
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL82324%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for BL82324: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: CB32763
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB32763%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for CB32763: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: LY90448
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY90448%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for LY90448: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: CW68051
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW68051%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for CW68051: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: ZC12313
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12313%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for ZC12313: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: KC62935
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC62935%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for KC62935: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: DF14227
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF14227%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for DF14227: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: YB92663
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for YB92663: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: AU30700
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for AU30700: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: WJ53867
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ53867%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for WJ53867: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: US74499
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US74499%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for US74499: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: JW97025
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW97025%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for JW97025: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: JA20233
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA20233%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for JA20233: 2
2025-12-05 10:01:29 [auto1.it] INFO: Found listing with ID: LM82104
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM82104%27 HTTP/1.1" 200 None
2025-12-05 10:01:29 [auto1.it] INFO: Scrape type for LM82104: 2
2025-12-05 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW99743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC73786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH15526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU79981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM78467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR69258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG39549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF05502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM82104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW97025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US74499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET69772/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ53867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX72433> (referer: https://www.auto1.com/v1/car-details-view/JX72433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:31 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f113f0e3-1c06-5b9d-8753-63926f4a8151 with identifier: JX72433
2025-12-05 10:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f113f0e3-1c06-5b9d-8753-63926f4a8151 with scrape type 1
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f113f0e3-1c06-5b9d-8753-63926f4a8151
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_59bb72a907d399060a9bd398f4249ce9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_59bb72a907d399060a9bd398f4249ce9.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_8a51be8f4d4f1f4eb4b0dc8dd8bfe257.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_8a51be8f4d4f1f4eb4b0dc8dd8bfe257.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_49ef90941e286cfc4f45afb00121a0cb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_49ef90941e286cfc4f45afb00121a0cb.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_e20904778e3b09690d3b3a121d87f3fe.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e20904778e3b09690d3b3a121d87f3fe.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_70f2e20ef923acc0306fad8fcb28a632.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_70f2e20ef923acc0306fad8fcb28a632.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_b7b2d0f37c4242805aaffe85c7d8a263.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_b7b2d0f37c4242805aaffe85c7d8a263.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_7574e1cc47ae13860adf42157a5f8c48.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7574e1cc47ae13860adf42157a5f8c48.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_7024661c67c109f4e43b97a1408a6995.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7024661c67c109f4e43b97a1408a6995.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_9778f577b740dfdbbff7d5cf75c8fbdd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_9778f577b740dfdbbff7d5cf75c8fbdd.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_27b7b6812ea85bead85bc515ff2353fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_27b7b6812ea85bead85bc515ff2353fc.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_f34171dfdbc97c801e8747e83b7d5f6f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_f34171dfdbc97c801e8747e83b7d5f6f.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_be1de25cd7dcfb0d35069be9778ca7cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_be1de25cd7dcfb0d35069be9778ca7cd.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_5bc69c3f45963bdffd08ebab12921edd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5bc69c3f45963bdffd08ebab12921edd.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_5b55687c568485ddd769a25c11309acc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5b55687c568485ddd769a25c11309acc.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_e2cdbb88dcb043cc91a39ddaea3fea8a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e2cdbb88dcb043cc91a39ddaea3fea8a.jpg already downloaded
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Ff4%252Fa1f43f94d77c95ca4858d5e9d707fbc8%252Fpa%252FJX72433_4963179aa825b566b472070c4a5f338f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_4963179aa825b566b472070c4a5f338f.jpg already downloaded
2025-12-05 10:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f113f0e3-1c06-5b9d-8753-63926f4a8151, identifier: JX72433
2025-12-05 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f113f0e3-1c06-5b9d-8753-63926f4a8151 with identifier: JX72433
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2025-12-05 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2025-12-05 10:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f113f0e3-1c06-5b9d-8753-63926f4a8151 with identifier: JX72433
2025-12-05 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186889 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186889
2025-12-05 10:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f113f0e3-1c06-5b9d-8753-63926f4a8151 spider: auto1.it
2025-12-05 10:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f113f0e3-1c06-5b9d-8753-63926f4a8151 due to rule: high_mileage_for_country.json, error: 186889 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186889
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:01:34Z',
 'fuel_type': 'diesel',
 'id': 'f113f0e3-1c06-5b9d-8753-63926f4a8151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX72433',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 186889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_59bb72a907d399060a9bd398f4249ce9.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_8a51be8f4d4f1f4eb4b0dc8dd8bfe257.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_49ef90941e286cfc4f45afb00121a0cb.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e20904778e3b09690d3b3a121d87f3fe.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_70f2e20ef923acc0306fad8fcb28a632.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_b7b2d0f37c4242805aaffe85c7d8a263.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7574e1cc47ae13860adf42157a5f8c48.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7024661c67c109f4e43b97a1408a6995.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_9778f577b740dfdbbff7d5cf75c8fbdd.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_27b7b6812ea85bead85bc515ff2353fc.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_f34171dfdbc97c801e8747e83b7d5f6f.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_be1de25cd7dcfb0d35069be9778ca7cd.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5bc69c3f45963bdffd08ebab12921edd.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5b55687c568485ddd769a25c11309acc.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e2cdbb88dcb043cc91a39ddaea3fea8a.jpg',
                'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_4963179aa825b566b472070c4a5f338f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_59bb72a907d399060a9bd398f4249ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_8a51be8f4d4f1f4eb4b0dc8dd8bfe257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_49ef90941e286cfc4f45afb00121a0cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e20904778e3b09690d3b3a121d87f3fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_70f2e20ef923acc0306fad8fcb28a632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_b7b2d0f37c4242805aaffe85c7d8a263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7574e1cc47ae13860adf42157a5f8c48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_7024661c67c109f4e43b97a1408a6995.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_9778f577b740dfdbbff7d5cf75c8fbdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_27b7b6812ea85bead85bc515ff2353fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_f34171dfdbc97c801e8747e83b7d5f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_be1de25cd7dcfb0d35069be9778ca7cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5bc69c3f45963bdffd08ebab12921edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_5b55687c568485ddd769a25c11309acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_e2cdbb88dcb043cc91a39ddaea3fea8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f113f0e3-1c06-5b9d-8753-63926f4a8151/f113f0e3-1c06-5b9d-8753-63926f4a8151_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/f4/a1f43f94d77c95ca4858d5e9d707fbc8/pa/JX72433_4963179aa825b566b472070c4a5f338f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX72433%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Saving data for JX72433: {'created_time': 1764928892.685673, 'last_price_update_time': 1764928892.685686, 'auction_closing_time': 1765036894.0}
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX72433') HTTP/1.1" 204 0
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: ZD81765
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD81765%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Scrape type for ZD81765: 2
2025-12-05 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF58868> (referer: https://www.auto1.com/v1/car-details-view/HF58868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC73786> (referer: https://www.auto1.com/v1/car-details-view/EC73786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC69548> (referer: https://www.auto1.com/v1/car-details-view/KC69548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW99743> (referer: https://www.auto1.com/v1/car-details-view/HW99743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA20233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: SR31732
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR31732%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Scrape type for SR31732: 2
2025-12-05 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: NY39910
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY39910%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Scrape type for NY39910: 2
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: LX50050
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Scrape type for LX50050: 2
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: WG22278
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2025-12-05 10:01:32 [auto1.it] INFO: Scrape type for WG22278: 2
2025-12-05 10:01:32 [auto1.it] INFO: Found listing with ID: RG34096
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG34096%27 HTTP/1.1" 200 None
2025-12-05 10:01:33 [auto1.it] INFO: Scrape type for RG34096: 2
2025-12-05 10:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with identifier: HF58868
2025-12-05 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with scrape type 2
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with scrape type 2
2025-12-05 10:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 223648bb-c36a-5042-a7ce-8bdfc1ce98cc, identifier: HF58868
2025-12-05 10:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with identifier: EC73786
2025-12-05 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with scrape type 1
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg not downloaded yet
2025-12-05 10:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb301f23-b846-59b8-a80a-d0c1b587a519 with identifier: KC69548
2025-12-05 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb301f23-b846-59b8-a80a-d0c1b587a519 with scrape type 1
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_919ec27075bd96a881404e2daf798e24.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_919ec27075bd96a881404e2daf798e24.jpg not downloaded yet
2025-12-05 10:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c03521-5916-5702-a67c-2def21d5f964 with identifier: HW99743
2025-12-05 10:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c03521-5916-5702-a67c-2def21d5f964 with scrape type 1
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg not downloaded yet
2025-12-05 10:01:33 [auto1.it] INFO: Found listing with ID: GB75182
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB75182%27 HTTP/1.1" 200 None
2025-12-05 10:01:33 [auto1.it] INFO: Scrape type for GB75182: 2
2025-12-05 10:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with identifier: HF58868
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2025-12-05 10:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2025-12-05 10:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with identifier: HF58868
2025-12-05 10:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 223648bb-c36a-5042-a7ce-8bdfc1ce98cc with identifier: HF58868 to the API
2025-12-05 10:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HF58868>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.3L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:49:20Z',
 'fuel_type': 'petrol',
 'id': '223648bb-c36a-5042-a7ce-8bdfc1ce98cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF58868',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 91424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF58868%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Saving data for HF58868: {'auction_closing_time': 1765039760.0, 'created_time': 1762891770.452168, 'last_price_update_time': 1764928894.256984}
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF58868') HTTP/1.1" 204 0
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_aa963f5aa691fa7966feac847248c392.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_aa963f5aa691fa7966feac847248c392.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_a29c048c40d15aa597edb54cb5d94ced.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_a29c048c40d15aa597edb54cb5d94ced.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_0117445c4404dc03b2dba0aa658e1151.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0117445c4404dc03b2dba0aa658e1151.jpg not downloaded yet
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: HK56128
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK56128%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for HK56128: 1
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_d0944d1169623a112944a4fe028dbe81.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d0944d1169623a112944a4fe028dbe81.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_8c398f0b10b2a04889077f379caf7c53.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8c398f0b10b2a04889077f379caf7c53.jpg not downloaded yet
2025-12-05 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH15526> (referer: https://www.auto1.com/v1/car-details-view/YH15526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU79981> (referer: https://www.auto1.com/v1/car-details-view/XU79981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: ZF25118
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF25118%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for ZF25118: 2
2025-12-05 10:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_acc5f109cffa93e66246f29c7bc9c077.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_acc5f109cffa93e66246f29c7bc9c077.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg not downloaded yet
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: SW58220
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW58220%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for SW58220: 2
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_88451015b9df53fd32ea727f85bbca6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_88451015b9df53fd32ea727f85bbca6c.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_57ff15223d4884e1045e665fc420da5b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_57ff15223d4884e1045e665fc420da5b.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg not downloaded yet
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: GY23026
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY23026%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for GY23026: 2
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_44ac21cc4e3de0cf1363675094a3e065.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_44ac21cc4e3de0cf1363675094a3e065.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_0cc302dc06773eeb43f8011d30bd4109.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0cc302dc06773eeb43f8011d30bd4109.jpg not downloaded yet
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: PM40401
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM40401%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for PM40401: 2
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_43c3417676362decfcf22c1be10d0c75.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_43c3417676362decfcf22c1be10d0c75.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg not downloaded yet
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_ac2e56b37985e77f86e2f2786167fff1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_ac2e56b37985e77f86e2f2786167fff1.jpg not downloaded yet
2025-12-05 10:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89961586-e21e-53a4-a095-4bd0f4a03191 with identifier: YH15526
2025-12-05 10:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89961586-e21e-53a4-a095-4bd0f4a03191 with scrape type 2
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89961586-e21e-53a4-a095-4bd0f4a03191 with scrape type 2
2025-12-05 10:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89961586-e21e-53a4-a095-4bd0f4a03191, identifier: YH15526
2025-12-05 10:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84133d08-5cdb-5bb8-ab25-c8e24482d91b with identifier: XU79981
2025-12-05 10:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b with scrape type 1
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_2a01f0958c468d2ac04893ec9d19b970.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2a01f0958c468d2ac04893ec9d19b970.jpg not downloaded yet
2025-12-05 10:01:34 [auto1.it] INFO: Found listing with ID: NR27447
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR27447%27 HTTP/1.1" 200 None
2025-12-05 10:01:34 [auto1.it] INFO: Scrape type for NR27447: 2
2025-12-05 10:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89961586-e21e-53a4-a095-4bd0f4a03191 with identifier: YH15526
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89961586-e21e-53a4-a095-4bd0f4a03191 with identifier: YH15526
2025-12-05 10:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89961586-e21e-53a4-a095-4bd0f4a03191 with identifier: YH15526 to the API
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH15526>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:56:18Z',
 'fuel_type': 'diesel',
 'id': '89961586-e21e-53a4-a095-4bd0f4a03191',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH15526',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 99996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH15526%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [auto1.it] INFO: Saving data for YH15526: {'auction_closing_time': 1765040178.0, 'created_time': 1763755346.085794, 'last_price_update_time': 1764928895.453152}
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH15526') HTTP/1.1" 204 0
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_febc54288a87d7c166d9d88671e4d0d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_febc54288a87d7c166d9d88671e4d0d1.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_0d02cc821f84dde61d78e4460c5998b8.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_0d02cc821f84dde61d78e4460c5998b8.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_6a6d372ccaf671a91784159ef1613034.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6a6d372ccaf671a91784159ef1613034.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg not downloaded yet
2025-12-05 10:01:35 [auto1.it] INFO: Found listing with ID: HK99517
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK99517%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [auto1.it] INFO: Scrape type for HK99517: 2
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_d29072a81febb5e804654ad051b515a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d29072a81febb5e804654ad051b515a7.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg not downloaded yet
2025-12-05 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF05502> (referer: https://www.auto1.com/v1/car-details-view/GF05502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW97025> (referer: https://www.auto1.com/v1/car-details-view/JW97025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:35 [auto1.it] INFO: Found listing with ID: BM83226
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [auto1.it] INFO: Scrape type for BM83226: 2
2025-12-05 10:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG39549> (referer: https://www.auto1.com/v1/car-details-view/BG39549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR69258> (referer: https://www.auto1.com/v1/car-details-view/KR69258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_13a97e8229e31f070595796bb9893125.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_13a97e8229e31f070595796bb9893125.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_573acc3162d168fa27e71cedbd4ffaed.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_573acc3162d168fa27e71cedbd4ffaed.jpg not downloaded yet
2025-12-05 10:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:35 [auto1.it] INFO: Found listing with ID: ZD64809
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD64809%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [auto1.it] INFO: Scrape type for ZD64809: 2
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_58a818150817b40b15b33eb50dd7766b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_58a818150817b40b15b33eb50dd7766b.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_7d823f43950f52e8099d889bc3fcf085.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_7d823f43950f52e8099d889bc3fcf085.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_6b6a9749ddb55915f8a9de861f19c406.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6b6a9749ddb55915f8a9de861f19c406.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_5b06e42b281d4727284cc96f045fa403.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_5b06e42b281d4727284cc96f045fa403.jpg not downloaded yet
2025-12-05 10:01:35 [auto1.it] INFO: Found listing with ID: NS14568
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [auto1.it] INFO: Scrape type for NS14568: 2
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_7153d65306fbb95a8df8e40762f0d8de.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_7153d65306fbb95a8df8e40762f0d8de.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_f3a701235e44ee189055c4e392818b86.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_f3a701235e44ee189055c4e392818b86.jpg not downloaded yet
2025-12-05 10:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_a6314e6be5932cd371970360ba6f6f6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_a6314e6be5932cd371970360ba6f6f6c.jpg not downloaded yet
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_ffd49ff3bd44554db3af2c685d560196.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ffd49ff3bd44554db3af2c685d560196.jpg not downloaded yet
2025-12-05 10:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e133b7dd-1481-5fdd-9873-e854a0a676c9 with identifier: GF05502
2025-12-05 10:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e133b7dd-1481-5fdd-9873-e854a0a676c9 with scrape type 1
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg not downloaded yet
2025-12-05 10:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with identifier: JW97025
2025-12-05 10:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with scrape type 2
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with scrape type 2
2025-12-05 10:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6, identifier: JW97025
2025-12-05 10:01:36 [auto1.it] INFO: Found listing with ID: PR20498
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR20498%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [auto1.it] INFO: Scrape type for PR20498: 2
2025-12-05 10:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with identifier: JW97025
2025-12-05 10:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with identifier: JW97025
2025-12-05 10:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6 with identifier: JW97025 to the API
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JW97025>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2025-12-06T16:52:10Z',
 'fuel_type': 'diesel',
 'id': 'b35fa13f-c4d7-574f-9b8c-6fe5ab54c6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW97025',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 108750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2017}
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW97025%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [auto1.it] INFO: Saving data for JW97025: {'auction_closing_time': 1765039930.0, 'created_time': 1763668889.267515, 'last_price_update_time': 1764928896.52402}
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW97025') HTTP/1.1" 204 0
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg not downloaded yet
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_eb3cfea88392297106f07c80bf51c215.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_eb3cfea88392297106f07c80bf51c215.jpg not downloaded yet
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg not downloaded yet
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg not downloaded yet
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_a8417e981e0d867c5f51247e8736ae23.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_a8417e981e0d867c5f51247e8736ae23.jpg not downloaded yet
2025-12-05 10:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742e8ff7-eef2-59bd-8789-78ccbe896220 with identifier: BG39549
2025-12-05 10:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742e8ff7-eef2-59bd-8789-78ccbe896220 with scrape type 1
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_d8d1924bfe487fbf930af14652e8eab0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d8d1924bfe487fbf930af14652e8eab0.jpg not downloaded yet
2025-12-05 10:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c973c40-eefd-571b-be24-2d2075502481 with identifier: KR69258
2025-12-05 10:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c973c40-eefd-571b-be24-2d2075502481 with scrape type 1
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 0c973c40-eefd-571b-be24-2d2075502481
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_77a46ee8281d5b53b57e48fbccdee861.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_77a46ee8281d5b53b57e48fbccdee861.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_b2ff273e09accf143497bba51c959837.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b2ff273e09accf143497bba51c959837.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_e01b87347961721720fefbcb3a2ef817.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e01b87347961721720fefbcb3a2ef817.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_e4c30ce489e09c00bbe15c3706f95cbc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e4c30ce489e09c00bbe15c3706f95cbc.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_d44684b552ea036d82a87ef5bd525b3c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_d44684b552ea036d82a87ef5bd525b3c.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_5930c3752b929a0bbffafcf7d515bd7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5930c3752b929a0bbffafcf7d515bd7e.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_3dcdce4e6db60cc7fe1f3547433bd75c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_3dcdce4e6db60cc7fe1f3547433bd75c.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_344bc464f37fdfce74dc85c964c6562e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_344bc464f37fdfce74dc85c964c6562e.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_5c3848bc4c8362a97ddedc4c0d931bfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5c3848bc4c8362a97ddedc4c0d931bfa.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_ef7419fd106123305ba547e9b48460cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_ef7419fd106123305ba547e9b48460cc.jpg already downloaded
2025-12-05 10:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_4a5cced84b4aa8a1b25be2500c412168.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_4a5cced84b4aa8a1b25be2500c412168.jpg already downloaded
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_2e5711052b350b81488233752364dacf.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_2e5711052b350b81488233752364dacf.jpg already downloaded
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_b8f7540f1d112e9b840b17157b65681f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b8f7540f1d112e9b840b17157b65681f.jpg already downloaded
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_a60c93e803f4892f2dffa941e646ae46.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_a60c93e803f4892f2dffa941e646ae46.jpg already downloaded
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F8f%252Ff88f90e319d3a2261c5106b404176e4b%252Fpa%252FKR69258_9ab34ecb7ba4454d0c19a637945e66e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_9ab34ecb7ba4454d0c19a637945e66e6.jpg already downloaded
2025-12-05 10:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c973c40-eefd-571b-be24-2d2075502481, identifier: KR69258
2025-12-05 10:01:37 [auto1.it] INFO: Found listing with ID: CE05894
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE05894%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [auto1.it] INFO: Scrape type for CE05894: 0
2025-12-05 10:01:37 [auto1.it] INFO: Found listing with ID: AB82750
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB82750%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [auto1.it] INFO: Scrape type for AB82750: 2
2025-12-05 10:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c973c40-eefd-571b-be24-2d2075502481 with identifier: KR69258
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c973c40-eefd-571b-be24-2d2075502481 with identifier: KR69258
2025-12-05 10:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c973c40-eefd-571b-be24-2d2075502481 with identifier: KR69258 to the API
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR69258>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:35:34Z',
 'fuel_type': 'petrol',
 'id': '0c973c40-eefd-571b-be24-2d2075502481',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR69258',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 85452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_77a46ee8281d5b53b57e48fbccdee861.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b2ff273e09accf143497bba51c959837.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e01b87347961721720fefbcb3a2ef817.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e4c30ce489e09c00bbe15c3706f95cbc.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_d44684b552ea036d82a87ef5bd525b3c.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5930c3752b929a0bbffafcf7d515bd7e.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_3dcdce4e6db60cc7fe1f3547433bd75c.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_344bc464f37fdfce74dc85c964c6562e.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5c3848bc4c8362a97ddedc4c0d931bfa.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_ef7419fd106123305ba547e9b48460cc.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_4a5cced84b4aa8a1b25be2500c412168.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_2e5711052b350b81488233752364dacf.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b8f7540f1d112e9b840b17157b65681f.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_a60c93e803f4892f2dffa941e646ae46.jpg',
                'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_9ab34ecb7ba4454d0c19a637945e66e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_77a46ee8281d5b53b57e48fbccdee861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2678268,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b2ff273e09accf143497bba51c959837.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e01b87347961721720fefbcb3a2ef817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2247618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_e4c30ce489e09c00bbe15c3706f95cbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_d44684b552ea036d82a87ef5bd525b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5930c3752b929a0bbffafcf7d515bd7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1996661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_3dcdce4e6db60cc7fe1f3547433bd75c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_344bc464f37fdfce74dc85c964c6562e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_5c3848bc4c8362a97ddedc4c0d931bfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2355920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_ef7419fd106123305ba547e9b48460cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_4a5cced84b4aa8a1b25be2500c412168.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_2e5711052b350b81488233752364dacf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_b8f7540f1d112e9b840b17157b65681f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2270145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_a60c93e803f4892f2dffa941e646ae46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c973c40-eefd-571b-be24-2d2075502481/0c973c40-eefd-571b-be24-2d2075502481_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/8f/f88f90e319d3a2261c5106b404176e4b/pa/KR69258_9ab34ecb7ba4454d0c19a637945e66e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR69258%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [auto1.it] INFO: Saving data for KR69258: {'created_time': 1764928897.813689, 'last_price_update_time': 1764928897.813705, 'auction_closing_time': 1765038934.0}
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR69258') HTTP/1.1" 204 0
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_bf081c7f3d36912a25a5908d06a16cad.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_bf081c7f3d36912a25a5908d06a16cad.jpg not downloaded yet
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_45cb6393f278aee1cd2501af6275f611.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_45cb6393f278aee1cd2501af6275f611.jpg not downloaded yet
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_46d6b036d35996d409c1d07e0ae69884.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_46d6b036d35996d409c1d07e0ae69884.jpg not downloaded yet
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg not downloaded yet
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_28a8d91854cbba8387267f055459f0e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_28a8d91854cbba8387267f055459f0e2.jpg not downloaded yet
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9fccce89304bf67da1c641f1e432d68a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9fccce89304bf67da1c641f1e432d68a.jpg not downloaded yet
2025-12-05 10:01:38 [auto1.it] INFO: Found listing with ID: MD13712
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD13712%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [auto1.it] INFO: Scrape type for MD13712: 2
2025-12-05 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US74499> (referer: https://www.auto1.com/v1/car-details-view/US74499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM78467> (referer: https://www.auto1.com/v1/car-details-view/HM78467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET69772> (referer: https://www.auto1.com/v1/car-details-view/ET69772/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_47f6b9639855be93e69159c9b032ef12.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_47f6b9639855be93e69159c9b032ef12.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d6fe6491c6f142c05251574c99bd7a40.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d6fe6491c6f142c05251574c99bd7a40.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_aecf187df633434e0cef9f6c11d158a2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_aecf187df633434e0cef9f6c11d158a2.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_613aebdce2a49a2537c1925528573346.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_613aebdce2a49a2537c1925528573346.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg not downloaded yet
2025-12-05 10:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:38 [auto1.it] INFO: Found listing with ID: FJ06005
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ06005%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [auto1.it] INFO: Scrape type for FJ06005: 2
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_d4d4760d4b2da2523944dbd8579488ae.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_d4d4760d4b2da2523944dbd8579488ae.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_d666843562b708c37c5548a990773d1d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d666843562b708c37c5548a990773d1d.jpg not downloaded yet
2025-12-05 10:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:38 [auto1.it] INFO: Found listing with ID: LH16406
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH16406%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [auto1.it] INFO: Scrape type for LH16406: 2
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg not downloaded yet
2025-12-05 10:01:38 [auto1.it] INFO: Found listing with ID: VE23959
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23959%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [auto1.it] INFO: Scrape type for VE23959: 2
2025-12-05 10:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a36d2fe-3d16-5735-8b43-13021550ec5b with identifier: US74499
2025-12-05 10:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a36d2fe-3d16-5735-8b43-13021550ec5b with scrape type 2
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a36d2fe-3d16-5735-8b43-13021550ec5b with scrape type 2
2025-12-05 10:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a36d2fe-3d16-5735-8b43-13021550ec5b, identifier: US74499
2025-12-05 10:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 with identifier: HM78467
2025-12-05 10:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 with scrape type 2
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 with scrape type 2
2025-12-05 10:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6, identifier: HM78467
2025-12-05 10:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31a223cf-4a21-5702-b32e-7c76660f9b02 with identifier: ET69772
2025-12-05 10:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a223cf-4a21-5702-b32e-7c76660f9b02 with scrape type 1
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_5459886c185385847cc59cb0c35c6509.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5459886c185385847cc59cb0c35c6509.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_cd21a720f4e3fb9122735b4c5c235823.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_cd21a720f4e3fb9122735b4c5c235823.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg not downloaded yet
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg not downloaded yet
2025-12-05 10:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a36d2fe-3d16-5735-8b43-13021550ec5b with identifier: US74499
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2025-12-05 10:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a36d2fe-3d16-5735-8b43-13021550ec5b with identifier: US74499
2025-12-05 10:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a36d2fe-3d16-5735-8b43-13021550ec5b with identifier: US74499 to the API
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US74499>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:05:25Z',
 'fuel_type': 'diesel',
 'id': '1a36d2fe-3d16-5735-8b43-13021550ec5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US74499',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 103076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US74499%27 HTTP/1.1" 200 None
2025-12-05 10:01:39 [auto1.it] INFO: Saving data for US74499: {'auction_closing_time': 1765037125.0, 'created_time': 1763669389.82472, 'last_price_update_time': 1764928899.134056}
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US74499') HTTP/1.1" 204 0
2025-12-05 10:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 with identifier: HM78467
2025-12-05 10:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 with identifier: HM78467
2025-12-05 10:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176789 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176789
2025-12-05 10:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 spider: auto1.it
2025-12-05 10:01:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bfeb2f80-02f5-5a3f-9db3-da6ab88242a6 due to rule: high_mileage_for_country.json, error: 176789 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176789
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:38:59Z',
 'fuel_type': 'diesel',
 'id': 'bfeb2f80-02f5-5a3f-9db3-da6ab88242a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM78467',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 176789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM78467%27 HTTP/1.1" 200 None
2025-12-05 10:01:39 [auto1.it] INFO: Saving data for HM78467: {'auction_closing_time': 1765039139.0, 'created_time': 1763028199.353146, 'last_price_update_time': 1764928899.497771}
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HM78467') HTTP/1.1" 204 0
2025-12-05 10:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:39 [auto1.it] INFO: Found listing with ID: CA12776
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA12776%27 HTTP/1.1" 200 None
2025-12-05 10:01:39 [auto1.it] INFO: Scrape type for CA12776: 2
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg not downloaded yet
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f3dad0>
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg saved to cache
2025-12-05 10:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg not downloaded yet
2025-12-05 10:01:40 [auto1.it] INFO: Found listing with ID: CP36603
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP36603%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [auto1.it] INFO: Scrape type for CP36603: 2
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_b702448b7c4ed6c0dfd923aff928497f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_b702448b7c4ed6c0dfd923aff928497f.jpg not downloaded yet
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD81765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC15386> (referer: https://www.auto1.com/v1/car-details-view/VC15386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ53867> (referer: https://www.auto1.com/v1/car-details-view/WJ53867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_07922f22f303172e33e39c63b59e7254.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_07922f22f303172e33e39c63b59e7254.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_95523d860ba513c19476f7800cf29c2a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_95523d860ba513c19476f7800cf29c2a.jpg not downloaded yet
2025-12-05 10:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c7c50>
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg saved to cache
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e073d0>
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg saved to cache
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:01:40 [auto1.it] INFO: Found listing with ID: TU05159
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [auto1.it] INFO: Scrape type for TU05159: 2
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg not downloaded yet
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5459886c185385847cc59cb0c35c6509.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg not downloaded yet
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg not downloaded yet
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9fccce89304bf67da1c641f1e432d68a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_28a8d91854cbba8387267f055459f0e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:40 [auto1.it] INFO: Found listing with ID: JU85214
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU85214%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [auto1.it] INFO: Scrape type for JU85214: 2
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_692ea8f891b37339c075b413bcba8fbe.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_692ea8f891b37339c075b413bcba8fbe.jpg not downloaded yet
2025-12-05 10:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:40 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe99905-733d-5362-8e94-527876efd821 with identifier: VC15386
2025-12-05 10:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe99905-733d-5362-8e94-527876efd821 with scrape type 1
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_65c07b445e29d5b4b971091fc92532c9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_65c07b445e29d5b4b971091fc92532c9.jpg not downloaded yet
2025-12-05 10:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c35a9952-5d5d-5c43-9567-fedabf9b6c04 with identifier: WJ53867
2025-12-05 10:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c35a9952-5d5d-5c43-9567-fedabf9b6c04 with scrape type 2
2025-12-05 10:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c35a9952-5d5d-5c43-9567-fedabf9b6c04 with scrape type 2
2025-12-05 10:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c35a9952-5d5d-5c43-9567-fedabf9b6c04, identifier: WJ53867
2025-12-05 10:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg not downloaded yet
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_bb266d77354597452d045b2b123e3bd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_bb266d77354597452d045b2b123e3bd2.jpg not downloaded yet
2025-12-05 10:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c35a9952-5d5d-5c43-9567-fedabf9b6c04 with identifier: WJ53867
2025-12-05 10:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c35a9952-5d5d-5c43-9567-fedabf9b6c04 with identifier: WJ53867
2025-12-05 10:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c35a9952-5d5d-5c43-9567-fedabf9b6c04 with identifier: WJ53867 to the API
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ53867>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:25:27Z',
 'fuel_type': 'diesel',
 'id': 'c35a9952-5d5d-5c43-9567-fedabf9b6c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ53867',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 66209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2019}
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ53867%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [auto1.it] INFO: Saving data for WJ53867: {'auction_closing_time': 1765038327.0, 'created_time': 1763755235.712489, 'last_price_update_time': 1764928901.469011}
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ53867') HTTP/1.1" 204 0
2025-12-05 10:01:41 [auto1.it] INFO: Found listing with ID: TC56605
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [auto1.it] INFO: Scrape type for TC56605: 2
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg not downloaded yet
2025-12-05 10:01:41 [auto1.it] INFO: Found listing with ID: VL40071
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL40071%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [auto1.it] INFO: Scrape type for VL40071: 2
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_b59875e3999f882e208c30c0f61a00dd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_b59875e3999f882e208c30c0f61a00dd.jpg not downloaded yet
2025-12-05 10:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK56128/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da334bed0>
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_5459886c185385847cc59cb0c35c6509.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5459886c185385847cc59cb0c35c6509.jpg saved to cache
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_e760504218a6107fe799ceb76c708a65.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_e760504218a6107fe799ceb76c708a65.jpg not downloaded yet
2025-12-05 10:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg not downloaded yet
2025-12-05 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL05291> (referer: https://www.auto1.com/v1/car-details-view/EL05291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:42 [auto1.it] INFO: Found listing with ID: RE49943
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49943%27 HTTP/1.1" 200 None
2025-12-05 10:01:42 [auto1.it] INFO: Scrape type for RE49943: 2
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_9f455f82bf417b0904fea93dd00133b2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_9f455f82bf417b0904fea93dd00133b2.jpg not downloaded yet
2025-12-05 10:01:42 [auto1.it] INFO: Found listing with ID: JG92403
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG92403%27 HTTP/1.1" 200 None
2025-12-05 10:01:42 [auto1.it] INFO: Scrape type for JG92403: 2
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_5db217aadec7408ece23d6f19ea90402.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_5db217aadec7408ece23d6f19ea90402.jpg not downloaded yet
2025-12-05 10:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM82104> (referer: https://www.auto1.com/v1/car-details-view/LM82104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d0a710>
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9fccce89304bf67da1c641f1e432d68a.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9fccce89304bf67da1c641f1e432d68a.jpg saved to cache
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d86a90>
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_28a8d91854cbba8387267f055459f0e2.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_28a8d91854cbba8387267f055459f0e2.jpg saved to cache
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da335d510>
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg saved to cache
2025-12-05 10:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33b37d0>
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg saved to cache
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_95523d860ba513c19476f7800cf29c2a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg not downloaded yet
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg not downloaded yet
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:43 [auto1.it] INFO: Found listing with ID: XV69031
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV69031%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [auto1.it] INFO: Scrape type for XV69031: 1
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg not downloaded yet
2025-12-05 10:01:43 [auto1.it] INFO: Found listing with ID: MR60103
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR60103%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [auto1.it] INFO: Scrape type for MR60103: 2
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg not downloaded yet
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_4f3050dd7989d8963a99b62b45a606fc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4f3050dd7989d8963a99b62b45a606fc.jpg not downloaded yet
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_c51a61e618591fa15c2f19892d434bdb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_c51a61e618591fa15c2f19892d434bdb.jpg not downloaded yet
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK99517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ86916> (referer: https://www.auto1.com/v1/car-details-view/FJ86916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ06005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE23959/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2025-12-05 10:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc3f531-e2be-5af5-8f91-7458330e533c with scrape type 2
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc3f531-e2be-5af5-8f91-7458330e533c with scrape type 2
2025-12-05 10:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bc3f531-e2be-5af5-8f91-7458330e533c, identifier: EL05291
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e90890>
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg saved to cache
2025-12-05 10:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f12d50>
2025-12-05 10:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg saved to cache
2025-12-05 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e751227f-27c9-543a-b786-b7451061090a with identifier: LM82104
2025-12-05 10:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e751227f-27c9-543a-b786-b7451061090a with scrape type 2
2025-12-05 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e751227f-27c9-543a-b786-b7451061090a with scrape type 2
2025-12-05 10:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e751227f-27c9-543a-b786-b7451061090a, identifier: LM82104
2025-12-05 10:01:44 [auto1.it] INFO: Found listing with ID: GL72110
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [auto1.it] INFO: Scrape type for GL72110: 2
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_527ac36b67b13cea1380f091d8397082.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_527ac36b67b13cea1380f091d8397082.jpg not downloaded yet
2025-12-05 10:01:44 [auto1.it] INFO: Found listing with ID: SH45068
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH45068%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [auto1.it] INFO: Scrape type for SH45068: 2
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg not downloaded yet
2025-12-05 10:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2025-12-05 10:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bc3f531-e2be-5af5-8f91-7458330e533c with identifier: EL05291
2025-12-05 10:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191911 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191911
2025-12-05 10:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8bc3f531-e2be-5af5-8f91-7458330e533c spider: auto1.it
2025-12-05 10:01:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8bc3f531-e2be-5af5-8f91-7458330e533c due to rule: high_mileage_for_country.json, error: 191911 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191911
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:07:18Z',
 'fuel_type': 'diesel',
 'id': '8bc3f531-e2be-5af5-8f91-7458330e533c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL05291',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 191911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2020}
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05291%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [auto1.it] INFO: Saving data for EL05291: {'auction_closing_time': 1765037238.0, 'created_time': 1762253927.254064, 'last_price_update_time': 1764928904.554706}
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL05291') HTTP/1.1" 204 0
2025-12-05 10:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e751227f-27c9-543a-b786-b7451061090a with identifier: LM82104
2025-12-05 10:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e751227f-27c9-543a-b786-b7451061090a with identifier: LM82104
2025-12-05 10:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e751227f-27c9-543a-b786-b7451061090a with identifier: LM82104 to the API
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM82104>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 85,
 'expiration_date': '2025-12-06T16:37:12Z',
 'fuel_type': 'diesel',
 'id': 'e751227f-27c9-543a-b786-b7451061090a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM82104',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 48768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM82104%27 HTTP/1.1" 200 None
2025-12-05 10:01:44 [auto1.it] INFO: Saving data for LM82104: {'auction_closing_time': 1765039032.0, 'created_time': 1764619415.118469, 'last_price_update_time': 1764928904.968145}
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM82104') HTTP/1.1" 204 0
2025-12-05 10:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_b59875e3999f882e208c30c0f61a00dd.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_16b33338ae3e028598e2c05896fb5d3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_16b33338ae3e028598e2c05896fb5d3a.jpg not downloaded yet
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_958586b09706dfa62ed2ea58f8c1d248.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_958586b09706dfa62ed2ea58f8c1d248.jpg not downloaded yet
2025-12-05 10:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30d28d0>
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_95523d860ba513c19476f7800cf29c2a.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_95523d860ba513c19476f7800cf29c2a.jpg saved to cache
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:45 [auto1.it] INFO: Found listing with ID: GW22031
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW22031%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [auto1.it] INFO: Scrape type for GW22031: 2
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_5258392b312ccb50b76516afe9a963e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5258392b312ccb50b76516afe9a963e2.jpg not downloaded yet
2025-12-05 10:01:45 [auto1.it] INFO: Found listing with ID: ZJ01897
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ01897%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [auto1.it] INFO: Scrape type for ZJ01897: 2
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_810129b9a1baf61de4f2157c72915fb7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_810129b9a1baf61de4f2157c72915fb7.jpg not downloaded yet
2025-12-05 10:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU05159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg not downloaded yet
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30c3ed0>
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg saved to cache
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2025-12-05 10:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47574182-9bc7-5010-9524-7692a3da5c21 with scrape type 1
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 47574182-9bc7-5010-9524-7692a3da5c21
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_be438f201c5dae0b8e9f3770acbf7b07.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_be438f201c5dae0b8e9f3770acbf7b07.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_5180a64ec7fd4deff273beeaf3735c6b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_5180a64ec7fd4deff273beeaf3735c6b.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_4bc7b8979fa194597f2898d83f8d260b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_4bc7b8979fa194597f2898d83f8d260b.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_37d72d792b633a91460a295a5acebdfa.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_37d72d792b633a91460a295a5acebdfa.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_35d8871889701fa96a40ab8886cd7a05.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_35d8871889701fa96a40ab8886cd7a05.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_6616fca0293dd2eaf8109f965d87a572.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_6616fca0293dd2eaf8109f965d87a572.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_c103179c26fa6f7caa0a757c56d0eb4d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_c103179c26fa6f7caa0a757c56d0eb4d.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_3812f6ddbe8438c16c2199b1af62b51a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_3812f6ddbe8438c16c2199b1af62b51a.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_96c647fce2c12a289c5499bed139a8e6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_96c647fce2c12a289c5499bed139a8e6.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_e50e63abb250e009b5add71b978ae993.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_e50e63abb250e009b5add71b978ae993.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_12e56d4d64e8bdfa98943d68211c4919.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_12e56d4d64e8bdfa98943d68211c4919.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_d779ce3e1bd6490daec274e19131e667.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_d779ce3e1bd6490daec274e19131e667.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_321f55dbe30ee8a44498496061658c6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_321f55dbe30ee8a44498496061658c6c.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_ec35471c16942f7dcce2d6234b4615eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_ec35471c16942f7dcce2d6234b4615eb.jpg already downloaded
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F96%252Fa296eb1582400181ddd3ff9d5b31d231%252Fpa%252FFJ86916_307a50d6be5cfb8369ea12cf55f30e52.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_307a50d6be5cfb8369ea12cf55f30e52.jpg already downloaded
2025-12-05 10:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47574182-9bc7-5010-9524-7692a3da5c21, identifier: FJ86916
2025-12-05 10:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_5db217aadec7408ece23d6f19ea90402.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:46 [auto1.it] INFO: Found listing with ID: CA23439
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA23439%27 HTTP/1.1" 200 None
2025-12-05 10:01:46 [auto1.it] INFO: Scrape type for CA23439: 2
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_52fa024c217f0b0aff47540dd2a1834c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_52fa024c217f0b0aff47540dd2a1834c.jpg not downloaded yet
2025-12-05 10:01:46 [auto1.it] INFO: Found listing with ID: HJ41912
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ41912%27 HTTP/1.1" 200 None
2025-12-05 10:01:46 [auto1.it] INFO: Scrape type for HJ41912: 1
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg not downloaded yet
2025-12-05 10:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2025-12-05 10:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2025-12-05 10:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169996 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169996
2025-12-05 10:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 47574182-9bc7-5010-9524-7692a3da5c21 spider: auto1.it
2025-12-05 10:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 47574182-9bc7-5010-9524-7692a3da5c21 due to rule: high_mileage_for_country.json, error: 169996 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169996
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:27:49Z',
 'fuel_type': 'gas',
 'id': '47574182-9bc7-5010-9524-7692a3da5c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ86916',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 169996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_be438f201c5dae0b8e9f3770acbf7b07.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_5180a64ec7fd4deff273beeaf3735c6b.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_4bc7b8979fa194597f2898d83f8d260b.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_37d72d792b633a91460a295a5acebdfa.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_35d8871889701fa96a40ab8886cd7a05.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_6616fca0293dd2eaf8109f965d87a572.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_c103179c26fa6f7caa0a757c56d0eb4d.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_3812f6ddbe8438c16c2199b1af62b51a.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_96c647fce2c12a289c5499bed139a8e6.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_e50e63abb250e009b5add71b978ae993.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_12e56d4d64e8bdfa98943d68211c4919.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_d779ce3e1bd6490daec274e19131e667.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_321f55dbe30ee8a44498496061658c6c.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_ec35471c16942f7dcce2d6234b4615eb.jpg',
                'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_307a50d6be5cfb8369ea12cf55f30e52.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_be438f201c5dae0b8e9f3770acbf7b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_5180a64ec7fd4deff273beeaf3735c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_4bc7b8979fa194597f2898d83f8d260b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_37d72d792b633a91460a295a5acebdfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_35d8871889701fa96a40ab8886cd7a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_6616fca0293dd2eaf8109f965d87a572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_c103179c26fa6f7caa0a757c56d0eb4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_3812f6ddbe8438c16c2199b1af62b51a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_96c647fce2c12a289c5499bed139a8e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_e50e63abb250e009b5add71b978ae993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_12e56d4d64e8bdfa98943d68211c4919.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_d779ce3e1bd6490daec274e19131e667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_321f55dbe30ee8a44498496061658c6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_ec35471c16942f7dcce2d6234b4615eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47574182-9bc7-5010-9524-7692a3da5c21/47574182-9bc7-5010-9524-7692a3da5c21_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/96/a296eb1582400181ddd3ff9d5b31d231/pa/FJ86916_307a50d6be5cfb8369ea12cf55f30e52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Benzin / LPG Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2018}
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2025-12-05 10:01:46 [auto1.it] INFO: Saving data for FJ86916: {'created_time': 1764928906.633384, 'last_price_update_time': 1764928906.633401, 'auction_closing_time': 1765038469.0}
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ86916') HTTP/1.1" 204 0
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30cad10>
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg saved to cache
2025-12-05 10:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30ce450>
2025-12-05 10:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg saved to cache
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2de7a50>
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg saved to cache
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2ddd1d0>
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_b59875e3999f882e208c30c0f61a00dd.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_b59875e3999f882e208c30c0f61a00dd.jpg saved to cache
2025-12-05 10:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_c51a61e618591fa15c2f19892d434bdb.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4f3050dd7989d8963a99b62b45a606fc.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:47 [auto1.it] INFO: Found listing with ID: YZ75432
2025-12-05 10:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ75432%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for YZ75432: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg not downloaded yet
2025-12-05 10:01:48 [auto1.it] INFO: Found listing with ID: XL58334
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL58334%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for XL58334: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg not downloaded yet
2025-12-05 10:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC56605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:48 [auto1.it] INFO: Found listing with ID: CZ56358
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ56358%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for CZ56358: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_f5c603f750f650a02e6a130d17e8a317.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f5c603f750f650a02e6a130d17e8a317.jpg not downloaded yet
2025-12-05 10:01:48 [auto1.it] INFO: Found listing with ID: NT50828
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT50828%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for NT50828: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg not downloaded yet
2025-12-05 10:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2eec0d0>
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_5db217aadec7408ece23d6f19ea90402.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_5db217aadec7408ece23d6f19ea90402.jpg saved to cache
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_958586b09706dfa62ed2ea58f8c1d248.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_810129b9a1baf61de4f2157c72915fb7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:48 [auto1.it] INFO: Found listing with ID: AF54996
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF54996%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for AF54996: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_383b02af92fa42ff822484feb598d41a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_383b02af92fa42ff822484feb598d41a.jpg not downloaded yet
2025-12-05 10:01:48 [auto1.it] INFO: Found listing with ID: VW00442
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW00442%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [auto1.it] INFO: Scrape type for VW00442: 2
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg not downloaded yet
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bed90>
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg saved to cache
2025-12-05 10:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f22590>
2025-12-05 10:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_c51a61e618591fa15c2f19892d434bdb.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_c51a61e618591fa15c2f19892d434bdb.jpg saved to cache
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f79090>
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_4f3050dd7989d8963a99b62b45a606fc.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4f3050dd7989d8963a99b62b45a606fc.jpg saved to cache
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:49 [auto1.it] INFO: Found listing with ID: AX48769
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX48769%27 HTTP/1.1" 200 None
2025-12-05 10:01:49 [auto1.it] INFO: Scrape type for AX48769: 2
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_3792c74b314f40de319eda9fc0dd8b61.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_3792c74b314f40de319eda9fc0dd8b61.jpg not downloaded yet
2025-12-05 10:01:49 [auto1.it] INFO: Found listing with ID: PR91188
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2025-12-05 10:01:49 [auto1.it] INFO: Scrape type for PR91188: 1
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_6d519bc5a13487080132494967f5b4aa.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6d519bc5a13487080132494967f5b4aa.jpg not downloaded yet
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da303a750>
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg saved to cache
2025-12-05 10:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e00810>
2025-12-05 10:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_958586b09706dfa62ed2ea58f8c1d248.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_958586b09706dfa62ed2ea58f8c1d248.jpg saved to cache
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f03990>
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_810129b9a1baf61de4f2157c72915fb7.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_810129b9a1baf61de4f2157c72915fb7.jpg saved to cache
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [auto1.it] INFO: Found listing with ID: WP71679
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71679%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [auto1.it] INFO: Scrape type for WP71679: 2
2025-12-05 10:01:50 [auto1.it] INFO: Found listing with ID: JZ82526
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ82526%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [auto1.it] INFO: Scrape type for JZ82526: 2
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_6f58446a6c44e583997d606139083908.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6f58446a6c44e583997d606139083908.jpg not downloaded yet
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0117445c4404dc03b2dba0aa658e1151.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_52fa024c217f0b0aff47540dd2a1834c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f5c603f750f650a02e6a130d17e8a317.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [auto1.it] INFO: Found listing with ID: HS25644
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS25644%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [auto1.it] INFO: Scrape type for HS25644: 2
2025-12-05 10:01:50 [auto1.it] INFO: Found listing with ID: WZ58856
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [auto1.it] INFO: Scrape type for WZ58856: 2
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg not downloaded yet
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3019fd0>
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg saved to cache
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6d519bc5a13487080132494967f5b4aa.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:50 [auto1.it] INFO: Found listing with ID: ZD98375
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [auto1.it] INFO: Scrape type for ZD98375: 2
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_83040ec2a4ac71b452ff8a86e988b515.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_83040ec2a4ac71b452ff8a86e988b515.jpg not downloaded yet
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34a3d10>
2025-12-05 10:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg saved to cache
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f16490>
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_0117445c4404dc03b2dba0aa658e1151.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0117445c4404dc03b2dba0aa658e1151.jpg saved to cache
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bb210>
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_52fa024c217f0b0aff47540dd2a1834c.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_52fa024c217f0b0aff47540dd2a1834c.jpg saved to cache
2025-12-05 10:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33d7fd0>
2025-12-05 10:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_f5c603f750f650a02e6a130d17e8a317.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f5c603f750f650a02e6a130d17e8a317.jpg saved to cache
2025-12-05 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c0dd0>
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg saved to cache
2025-12-05 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:52 [auto1.it] INFO: Found listing with ID: GL17856
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL17856%27 HTTP/1.1" 200 None
2025-12-05 10:01:52 [auto1.it] INFO: Scrape type for GL17856: 2
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg not downloaded yet
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6f58446a6c44e583997d606139083908.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:52 [auto1.it] INFO: Found listing with ID: SR77260
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR77260%27 HTTP/1.1" 200 None
2025-12-05 10:01:52 [auto1.it] INFO: Scrape type for SR77260: 2
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT50828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ56358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR60103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK56128> (referer: https://www.auto1.com/v1/car-details-view/HK56128/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV69031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU05159> (referer: https://www.auto1.com/v1/car-details-view/TU05159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ41912/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:52 [auto1.it] INFO: Found listing with ID: AH71898
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2025-12-05 10:01:52 [auto1.it] INFO: Scrape type for AH71898: 2
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3edccd0>
2025-12-05 10:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_6d519bc5a13487080132494967f5b4aa.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6d519bc5a13487080132494967f5b4aa.jpg saved to cache
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_83040ec2a4ac71b452ff8a86e988b515.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:53 [auto1.it] INFO: Found listing with ID: FX72722
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX72722%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [auto1.it] INFO: Scrape type for FX72722: 2
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da303a490>
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_6f58446a6c44e583997d606139083908.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6f58446a6c44e583997d606139083908.jpg saved to cache
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8e6325-94e4-581c-87e4-2969815a4a68 with identifier: HK56128
2025-12-05 10:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8e6325-94e4-581c-87e4-2969815a4a68 with scrape type 1
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7d8e6325-94e4-581c-87e4-2969815a4a68
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_20dfe5389c1016e8d3c63d29b8ccd410.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_20dfe5389c1016e8d3c63d29b8ccd410.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_fa2bc0b65b80bc26e47deb66956a1648.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fa2bc0b65b80bc26e47deb66956a1648.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_fd9f032870a7acc3af670ec0c95159ff.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fd9f032870a7acc3af670ec0c95159ff.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_a2259d5b210395c7bf58e61abc465b0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a2259d5b210395c7bf58e61abc465b0b.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_3c6b70c12c7bcbffadc11d5fd3610934.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_3c6b70c12c7bcbffadc11d5fd3610934.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_2185e3054e58a907918b95f7202a21cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2185e3054e58a907918b95f7202a21cf.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_244ae832122da9ace93c0832ba993f3f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_244ae832122da9ace93c0832ba993f3f.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_a45d3ff0200fa6b74a4d25db57507a8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a45d3ff0200fa6b74a4d25db57507a8f.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_16a1c21efe84c6c22b17282702d623cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_16a1c21efe84c6c22b17282702d623cd.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_d9ab98a071b5ad2b25e9f4a2badc972c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_d9ab98a071b5ad2b25e9f4a2badc972c.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_6e2520ce52a7157dad51ba7c0abe2eba.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_6e2520ce52a7157dad51ba7c0abe2eba.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_7654742747cc8b59c1d63df3d66e0f51.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_7654742747cc8b59c1d63df3d66e0f51.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_9880d3aae703cff388bf266f6646198c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_9880d3aae703cff388bf266f6646198c.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_2ad24da8bfddc9640a84541ca8c31706.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2ad24da8bfddc9640a84541ca8c31706.jpg already downloaded
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F54%252F08545555207d3e3ce3c6ec15063d52ce%252Fpa%252FHK56128_8d377a8b6fe9a8fbb2117c754c80e95b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_8d377a8b6fe9a8fbb2117c754c80e95b.jpg already downloaded
2025-12-05 10:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d8e6325-94e4-581c-87e4-2969815a4a68, identifier: HK56128
2025-12-05 10:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2025-12-05 10:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4af6dec-189a-5b90-9f20-90539a7373c5 with scrape type 2
2025-12-05 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4af6dec-189a-5b90-9f20-90539a7373c5 with scrape type 2
2025-12-05 10:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4af6dec-189a-5b90-9f20-90539a7373c5, identifier: TU05159
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db008de50>
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg saved to cache
2025-12-05 10:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:54 [auto1.it] INFO: Found listing with ID: WR35053
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR35053%27 HTTP/1.1" 200 None
2025-12-05 10:01:54 [auto1.it] INFO: Scrape type for WR35053: 2
2025-12-05 10:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d8e6325-94e4-581c-87e4-2969815a4a68 with identifier: HK56128
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2025-12-05 10:01:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d8e6325-94e4-581c-87e4-2969815a4a68 with identifier: HK56128
2025-12-05 10:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d8e6325-94e4-581c-87e4-2969815a4a68 with identifier: HK56128 to the API
2025-12-05 10:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK56128>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2025-12-06T16:16:08Z',
 'fuel_type': 'hybrid',
 'id': '7d8e6325-94e4-581c-87e4-2969815a4a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK56128',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 34272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_20dfe5389c1016e8d3c63d29b8ccd410.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fa2bc0b65b80bc26e47deb66956a1648.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fd9f032870a7acc3af670ec0c95159ff.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a2259d5b210395c7bf58e61abc465b0b.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_3c6b70c12c7bcbffadc11d5fd3610934.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2185e3054e58a907918b95f7202a21cf.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_244ae832122da9ace93c0832ba993f3f.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a45d3ff0200fa6b74a4d25db57507a8f.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_16a1c21efe84c6c22b17282702d623cd.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_d9ab98a071b5ad2b25e9f4a2badc972c.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_6e2520ce52a7157dad51ba7c0abe2eba.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_7654742747cc8b59c1d63df3d66e0f51.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_9880d3aae703cff388bf266f6646198c.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2ad24da8bfddc9640a84541ca8c31706.jpg',
                'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_8d377a8b6fe9a8fbb2117c754c80e95b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_20dfe5389c1016e8d3c63d29b8ccd410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fa2bc0b65b80bc26e47deb66956a1648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_fd9f032870a7acc3af670ec0c95159ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934650,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a2259d5b210395c7bf58e61abc465b0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_3c6b70c12c7bcbffadc11d5fd3610934.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2185e3054e58a907918b95f7202a21cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992060,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_244ae832122da9ace93c0832ba993f3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3212590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_a45d3ff0200fa6b74a4d25db57507a8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_16a1c21efe84c6c22b17282702d623cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_d9ab98a071b5ad2b25e9f4a2badc972c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_6e2520ce52a7157dad51ba7c0abe2eba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_7654742747cc8b59c1d63df3d66e0f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_9880d3aae703cff388bf266f6646198c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_2ad24da8bfddc9640a84541ca8c31706.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e6325-94e4-581c-87e4-2969815a4a68/7d8e6325-94e4-581c-87e4-2969815a4a68_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/54/08545555207d3e3ce3c6ec15063d52ce/pa/HK56128_8d377a8b6fe9a8fbb2117c754c80e95b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2025-12-05 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK56128%27 HTTP/1.1" 200 None
2025-12-05 10:01:55 [auto1.it] INFO: Saving data for HK56128: {'created_time': 1764928915.956616, 'last_price_update_time': 1764928915.956633, 'auction_closing_time': 1765037768.0}
2025-12-05 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK56128') HTTP/1.1" 204 0
2025-12-05 10:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2025-12-05 10:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2025-12-05 10:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159 to the API
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU05159>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:51:10Z',
 'fuel_type': 'petrol',
 'id': 'd4af6dec-189a-5b90-9f20-90539a7373c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU05159',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 51487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2018}
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2025-12-05 10:01:56 [auto1.it] INFO: Saving data for TU05159: {'auction_closing_time': 1765039870.0, 'created_time': 1763669264.010816, 'last_price_update_time': 1764928916.55291}
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU05159') HTTP/1.1" 204 0
2025-12-05 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_3792c74b314f40de319eda9fc0dd8b61.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:56 [auto1.it] INFO: Found listing with ID: KL97300
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL97300%27 HTTP/1.1" 200 None
2025-12-05 10:01:56 [auto1.it] INFO: Scrape type for KL97300: 2
2025-12-05 10:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL40071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:56 [auto1.it] INFO: Found listing with ID: BA47590
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA47590%27 HTTP/1.1" 200 None
2025-12-05 10:01:56 [auto1.it] INFO: Scrape type for BA47590: 1
2025-12-05 10:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f79110>
2025-12-05 10:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_83040ec2a4ac71b452ff8a86e988b515.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_83040ec2a4ac71b452ff8a86e988b515.jpg saved to cache
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da309d950>
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg saved to cache
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:57 [auto1.it] INFO: Found listing with ID: GK18326
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK18326%27 HTTP/1.1" 200 None
2025-12-05 10:01:57 [auto1.it] INFO: Scrape type for GK18326: 1
2025-12-05 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR77260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ82526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD98375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL17856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:57 [auto1.it] INFO: Found listing with ID: SJ73434
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73434%27 HTTP/1.1" 200 None
2025-12-05 10:01:57 [auto1.it] INFO: Scrape type for SJ73434: 2
2025-12-05 10:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e4a710>
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_3792c74b314f40de319eda9fc0dd8b61.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_3792c74b314f40de319eda9fc0dd8b61.jpg saved to cache
2025-12-05 10:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34383d0>
2025-12-05 10:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg saved to cache
2025-12-05 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: GY55011
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2025-12-05 10:01:58 [auto1.it] INFO: Scrape type for GY55011: 2
2025-12-05 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_e760504218a6107fe799ceb76c708a65.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: JK28026
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK28026%27 HTTP/1.1" 200 None
2025-12-05 10:01:58 [auto1.it] INFO: Scrape type for JK28026: 2
2025-12-05 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ58856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_07922f22f303172e33e39c63b59e7254.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: RA25408
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2025-12-05 10:01:58 [auto1.it] INFO: Scrape type for RA25408: 1
2025-12-05 10:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC56605> (referer: https://www.auto1.com/v1/car-details-view/TC56605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: NR57705
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR57705%27 HTTP/1.1" 200 None
2025-12-05 10:01:58 [auto1.it] INFO: Scrape type for NR57705: 1
2025-12-05 10:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: PL31323
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL31323%27 HTTP/1.1" 200 None
2025-12-05 10:01:58 [auto1.it] INFO: Scrape type for PL31323: 2
2025-12-05 10:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ff8bd0>
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_e760504218a6107fe799ceb76c708a65.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_e760504218a6107fe799ceb76c708a65.jpg saved to cache
2025-12-05 10:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:58 [auto1.it] INFO: Found listing with ID: PZ69908
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ69908%27 HTTP/1.1" 200 None
2025-12-05 10:01:59 [auto1.it] INFO: Scrape type for PZ69908: 2
2025-12-05 10:01:59 [auto1.it] INFO: Found listing with ID: TV43098
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV43098%27 HTTP/1.1" 200 None
2025-12-05 10:01:59 [auto1.it] INFO: Scrape type for TV43098: 2
2025-12-05 10:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f0e010>
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_07922f22f303172e33e39c63b59e7254.jpg') HTTP/1.1" 204 0
2025-12-05 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_07922f22f303172e33e39c63b59e7254.jpg saved to cache
2025-12-05 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2025-12-05 10:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253d57e6-a640-5b9f-8371-692cd56b9a44 with scrape type 2
2025-12-05 10:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253d57e6-a640-5b9f-8371-692cd56b9a44 with scrape type 2
2025-12-05 10:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 253d57e6-a640-5b9f-8371-692cd56b9a44, identifier: TC56605
2025-12-05 10:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2025-12-05 10:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2025-12-05 10:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605 to the API
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC56605>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:15:44Z',
 'fuel_type': 'hybrid',
 'id': '253d57e6-a640-5b9f-8371-692cd56b9a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC56605',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 39428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2025-12-05 10:01:59 [auto1.it] INFO: Saving data for TC56605: {'auction_closing_time': 1765037744.0, 'created_time': 1764100953.569328, 'last_price_update_time': 1764928919.958993}
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TC56605') HTTP/1.1" 204 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: YU94462
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for YU94462: 2
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS25644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH71898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP71679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ41912> (referer: https://www.auto1.com/v1/car-details-view/HJ41912/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR35053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR91188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: XW54555
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW54555%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for XW54555: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: UX53135
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX53135%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for UX53135: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: RU90797
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU90797%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for RU90797: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: TY32521
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY32521%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for TY32521: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: WN75078
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN75078%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for WN75078: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: SP74056
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP74056%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for SP74056: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: NY23809
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY23809%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for NY23809: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: DN37442
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN37442%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for DN37442: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: FM27207
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM27207%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for FM27207: 0
2025-12-05 10:02:00 [auto1.it] INFO: Found listing with ID: PV32269
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV32269%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [auto1.it] INFO: Scrape type for PV32269: 0
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a99700-28e1-5da4-b83c-16455e009ded with identifier: HJ41912
2025-12-05 10:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a99700-28e1-5da4-b83c-16455e009ded with scrape type 1
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_77018c4403e85662889a4ebe95d10c53.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_77018c4403e85662889a4ebe95d10c53.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f433b04703f16a952f649da5f344cc29.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f433b04703f16a952f649da5f344cc29.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_efc74445a27d9c822ffa0b00f43060da.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_efc74445a27d9c822ffa0b00f43060da.jpg not downloaded yet
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL97300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_84949d157d3d13273422b3256e429212.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_84949d157d3d13273422b3256e429212.jpg not downloaded yet
2025-12-05 10:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_04a0caa0ffa379e48d21409751619e30.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_04a0caa0ffa379e48d21409751619e30.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_7df8684adfde72647d368b28012b1fb4.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_7df8684adfde72647d368b28012b1fb4.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg not downloaded yet
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_e39fecbc84d81b32e1cad37db850c932.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_e39fecbc84d81b32e1cad37db850c932.jpg not downloaded yet
2025-12-05 10:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_efc74445a27d9c822ffa0b00f43060da.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f7a010>
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_efc74445a27d9c822ffa0b00f43060da.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_efc74445a27d9c822ffa0b00f43060da.jpg saved to cache
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_e39fecbc84d81b32e1cad37db850c932.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV69031> (referer: https://www.auto1.com/v1/car-details-view/XV69031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ69908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA47590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_7df8684adfde72647d368b28012b1fb4.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db1ea3ed0>
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_e39fecbc84d81b32e1cad37db850c932.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_e39fecbc84d81b32e1cad37db850c932.jpg saved to cache
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_04a0caa0ffa379e48d21409751619e30.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY55011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR60103> (referer: https://www.auto1.com/v1/car-details-view/MR60103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK18326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ56358> (referer: https://www.auto1.com/v1/car-details-view/CZ56358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL31323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01484e79-e87d-5e1a-95a8-e64ba832d474 with identifier: XV69031
2025-12-05 10:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01484e79-e87d-5e1a-95a8-e64ba832d474 with scrape type 1
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 01484e79-e87d-5e1a-95a8-e64ba832d474
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_381d1c1244b65ffbc87471411b4f2ff2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_381d1c1244b65ffbc87471411b4f2ff2.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_21bf3cbc1aaf50a504d9658f62d39c67.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_21bf3cbc1aaf50a504d9658f62d39c67.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_1adf6edba1e414a553953409776ee8fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_1adf6edba1e414a553953409776ee8fd.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_a335daad8ccba7f4ab9b5c10e42e231a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a335daad8ccba7f4ab9b5c10e42e231a.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_861e5c057de605a98b764cc71149f573.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_861e5c057de605a98b764cc71149f573.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_7f0703680af0238b5c7ec661cbdca9c1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_7f0703680af0238b5c7ec661cbdca9c1.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_a058bb3224441dec4e4100c385a3444c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a058bb3224441dec4e4100c385a3444c.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_5deae9dee7d5bdf4124caeb8485414a6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5deae9dee7d5bdf4124caeb8485414a6.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_b2e24b0d5ecd07e124db73567ffc2c5d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_b2e24b0d5ecd07e124db73567ffc2c5d.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_2e81f167c36c96e595d1bf83cfa9b92d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_2e81f167c36c96e595d1bf83cfa9b92d.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_fdcd6f9d5cb4b302e0c1d74b11b71a09.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_fdcd6f9d5cb4b302e0c1d74b11b71a09.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_498ee6ec322d0664726df9d5241f6097.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_498ee6ec322d0664726df9d5241f6097.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_378bfe6ca720ac99abb259e1f4770af4.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_378bfe6ca720ac99abb259e1f4770af4.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_5e76f242bffa9eff74c0a8cfb6c84f8b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5e76f242bffa9eff74c0a8cfb6c84f8b.jpg already downloaded
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fae%252Fe8aedb5e94e36c3a95a39228d4033c95%252Fpa%252FXV69031_6bbf9845158d03a9f0fc2ed044e0c5f3.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_6bbf9845158d03a9f0fc2ed044e0c5f3.jpg already downloaded
2025-12-05 10:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01484e79-e87d-5e1a-95a8-e64ba832d474, identifier: XV69031
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db00e5f90>
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_7df8684adfde72647d368b28012b1fb4.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_7df8684adfde72647d368b28012b1fb4.jpg saved to cache
2025-12-05 10:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01484e79-e87d-5e1a-95a8-e64ba832d474 with identifier: XV69031
2025-12-05 10:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01484e79-e87d-5e1a-95a8-e64ba832d474 with identifier: XV69031
2025-12-05 10:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01484e79-e87d-5e1a-95a8-e64ba832d474 with identifier: XV69031 to the API
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV69031>
{'auction_title': '',
 'c_o_2_emission_value': 79,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 381,
 'expiration_date': '2025-12-06T16:42:13Z',
 'fuel_type': 'hybrid',
 'id': '01484e79-e87d-5e1a-95a8-e64ba832d474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV69031',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 52483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_381d1c1244b65ffbc87471411b4f2ff2.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_21bf3cbc1aaf50a504d9658f62d39c67.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_1adf6edba1e414a553953409776ee8fd.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a335daad8ccba7f4ab9b5c10e42e231a.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_861e5c057de605a98b764cc71149f573.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_7f0703680af0238b5c7ec661cbdca9c1.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a058bb3224441dec4e4100c385a3444c.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5deae9dee7d5bdf4124caeb8485414a6.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_b2e24b0d5ecd07e124db73567ffc2c5d.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_2e81f167c36c96e595d1bf83cfa9b92d.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_fdcd6f9d5cb4b302e0c1d74b11b71a09.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_498ee6ec322d0664726df9d5241f6097.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_378bfe6ca720ac99abb259e1f4770af4.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5e76f242bffa9eff74c0a8cfb6c84f8b.jpg',
                'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_6bbf9845158d03a9f0fc2ed044e0c5f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_381d1c1244b65ffbc87471411b4f2ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_21bf3cbc1aaf50a504d9658f62d39c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_1adf6edba1e414a553953409776ee8fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a335daad8ccba7f4ab9b5c10e42e231a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_861e5c057de605a98b764cc71149f573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_7f0703680af0238b5c7ec661cbdca9c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2005203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_a058bb3224441dec4e4100c385a3444c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5deae9dee7d5bdf4124caeb8485414a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_b2e24b0d5ecd07e124db73567ffc2c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_2e81f167c36c96e595d1bf83cfa9b92d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_fdcd6f9d5cb4b302e0c1d74b11b71a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_498ee6ec322d0664726df9d5241f6097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_378bfe6ca720ac99abb259e1f4770af4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_5e76f242bffa9eff74c0a8cfb6c84f8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01484e79-e87d-5e1a-95a8-e64ba832d474/01484e79-e87d-5e1a-95a8-e64ba832d474_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/ae/e8aedb5e94e36c3a95a39228d4033c95/pa/XV69031_6bbf9845158d03a9f0fc2ed044e0c5f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2022}
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV69031%27 HTTP/1.1" 200 None
2025-12-05 10:02:03 [auto1.it] INFO: Saving data for XV69031: {'created_time': 1764928923.525748, 'last_price_update_time': 1764928923.525763, 'auction_closing_time': 1765039333.0}
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV69031') HTTP/1.1" 204 0
2025-12-05 10:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f632d0>
2025-12-05 10:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_04a0caa0ffa379e48d21409751619e30.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_04a0caa0ffa379e48d21409751619e30.jpg saved to cache
2025-12-05 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with identifier: MR60103
2025-12-05 10:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with scrape type 2
2025-12-05 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with scrape type 2
2025-12-05 10:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f545b3a0-9f04-5f3c-bf20-4a67a625ca26, identifier: MR60103
2025-12-05 10:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with identifier: CZ56358
2025-12-05 10:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with scrape type 2
2025-12-05 10:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with scrape type 2
2025-12-05 10:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa, identifier: CZ56358
2025-12-05 10:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with identifier: MR60103
2025-12-05 10:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with identifier: MR60103
2025-12-05 10:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f545b3a0-9f04-5f3c-bf20-4a67a625ca26 with identifier: MR60103 to the API
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MR60103>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:54:07Z',
 'fuel_type': 'diesel',
 'id': 'f545b3a0-9f04-5f3c-bf20-4a67a625ca26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR60103',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 149993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2017}
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR60103%27 HTTP/1.1" 200 None
2025-12-05 10:02:04 [auto1.it] INFO: Saving data for MR60103: {'auction_closing_time': 1765040047.0, 'created_time': 1763755289.815108, 'last_price_update_time': 1764928924.640366}
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR60103') HTTP/1.1" 204 0
2025-12-05 10:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with identifier: CZ56358
2025-12-05 10:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with identifier: CZ56358
2025-12-05 10:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3baba34d-b096-5a5f-9374-0b2b7f8fe2fa with identifier: CZ56358 to the API
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ56358>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-06T16:15:46Z',
 'fuel_type': 'hybrid',
 'id': '3baba34d-b096-5a5f-9374-0b2b7f8fe2fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ56358',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 139481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Dynamic+',
 'transmission': 'automatic',
 'trim': 'Dynamic+',
 'year': 2018}
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ56358%27 HTTP/1.1" 200 None
2025-12-05 10:02:05 [auto1.it] INFO: Saving data for CZ56358: {'auction_closing_time': 1765037746.0, 'created_time': 1764101088.141361, 'last_price_update_time': 1764928925.019071}
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ56358') HTTP/1.1" 204 0
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_84949d157d3d13273422b3256e429212.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU94462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ58856> (referer: https://www.auto1.com/v1/car-details-view/WZ58856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR57705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef71d0>
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg saved to cache
2025-12-05 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da336b450>
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_84949d157d3d13273422b3256e429212.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_84949d157d3d13273422b3256e429212.jpg saved to cache
2025-12-05 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV43098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16bf553a-8598-50a0-84a3-3a5e41131e6c with identifier: WZ58856
2025-12-05 10:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16bf553a-8598-50a0-84a3-3a5e41131e6c with scrape type 2
2025-12-05 10:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16bf553a-8598-50a0-84a3-3a5e41131e6c with scrape type 2
2025-12-05 10:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16bf553a-8598-50a0-84a3-3a5e41131e6c, identifier: WZ58856
2025-12-05 10:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef6590>
2025-12-05 10:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg saved to cache
2025-12-05 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ee9290>
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg saved to cache
2025-12-05 10:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16bf553a-8598-50a0-84a3-3a5e41131e6c with identifier: WZ58856
2025-12-05 10:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16bf553a-8598-50a0-84a3-3a5e41131e6c with identifier: WZ58856
2025-12-05 10:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16bf553a-8598-50a0-84a3-3a5e41131e6c with identifier: WZ58856 to the API
2025-12-05 10:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WZ58856>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-06T16:06:54Z',
 'fuel_type': 'petrol',
 'id': '16bf553a-8598-50a0-84a3-3a5e41131e6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ58856',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 109575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ58856%27 HTTP/1.1" 200 None
2025-12-05 10:02:07 [auto1.it] INFO: Saving data for WZ58856: {'auction_closing_time': 1765037214.0, 'created_time': 1763669124.926827, 'last_price_update_time': 1764928927.207285}
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ58856') HTTP/1.1" 204 0
2025-12-05 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD98375> (referer: https://www.auto1.com/v1/car-details-view/ZD98375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ82526> (referer: https://www.auto1.com/v1/car-details-view/JZ82526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL97300> (referer: https://www.auto1.com/v1/car-details-view/KL97300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL17856> (referer: https://www.auto1.com/v1/car-details-view/GL17856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34517d0>
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg saved to cache
2025-12-05 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2025-12-05 10:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4369c20-f0e9-5274-8e13-0c0bb0145f18 with scrape type 2
2025-12-05 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4369c20-f0e9-5274-8e13-0c0bb0145f18 with scrape type 2
2025-12-05 10:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4369c20-f0e9-5274-8e13-0c0bb0145f18, identifier: ZD98375
2025-12-05 10:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65f974b-e1c5-5ec0-811a-07e4b4572c6b with identifier: JZ82526
2025-12-05 10:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65f974b-e1c5-5ec0-811a-07e4b4572c6b with scrape type 2
2025-12-05 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65f974b-e1c5-5ec0-811a-07e4b4572c6b with scrape type 2
2025-12-05 10:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d65f974b-e1c5-5ec0-811a-07e4b4572c6b, identifier: JZ82526
2025-12-05 10:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with identifier: KL97300
2025-12-05 10:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with scrape type 2
2025-12-05 10:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with scrape type 2
2025-12-05 10:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5, identifier: KL97300
2025-12-05 10:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d848024-40fb-5307-b82b-e360fa01d543 with identifier: GL17856
2025-12-05 10:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d848024-40fb-5307-b82b-e360fa01d543 with scrape type 2
2025-12-05 10:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d848024-40fb-5307-b82b-e360fa01d543 with scrape type 2
2025-12-05 10:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d848024-40fb-5307-b82b-e360fa01d543, identifier: GL17856
2025-12-05 10:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2025-12-05 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2025-12-05 10:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375 to the API
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD98375>
{'auction_title': '',
 'c_o_2_emission_value': 7,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:49:15Z',
 'fuel_type': 'diesel',
 'id': 'a4369c20-f0e9-5274-8e13-0c0bb0145f18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD98375',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 112236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2025-12-05 10:02:08 [auto1.it] INFO: Saving data for ZD98375: {'auction_closing_time': 1765039755.0, 'created_time': 1763669217.859214, 'last_price_update_time': 1764928928.643348}
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD98375') HTTP/1.1" 204 0
2025-12-05 10:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d65f974b-e1c5-5ec0-811a-07e4b4572c6b with identifier: JZ82526
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2025-12-05 10:02:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d65f974b-e1c5-5ec0-811a-07e4b4572c6b with identifier: JZ82526
2025-12-05 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186915 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186915
2025-12-05 10:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d65f974b-e1c5-5ec0-811a-07e4b4572c6b spider: auto1.it
2025-12-05 10:02:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d65f974b-e1c5-5ec0-811a-07e4b4572c6b due to rule: high_mileage_for_country.json, error: 186915 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186915
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 211,
 'expiration_date': '2025-12-06T16:59:25Z',
 'fuel_type': 'diesel',
 'id': 'd65f974b-e1c5-5ec0-811a-07e4b4572c6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ82526',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 186915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ82526%27 HTTP/1.1" 200 None
2025-12-05 10:02:09 [auto1.it] INFO: Saving data for JZ82526: {'auction_closing_time': 1765040365.0, 'created_time': 1764619447.425578, 'last_price_update_time': 1764928929.104379}
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ82526') HTTP/1.1" 204 0
2025-12-05 10:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with identifier: KL97300
2025-12-05 10:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with identifier: KL97300
2025-12-05 10:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5 with identifier: KL97300 to the API
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL97300>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:50:58Z',
 'fuel_type': 'petrol',
 'id': '7fc3d4eb-1b1d-5eab-938a-7b9e2083c9d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL97300',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 53991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2018}
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL97300%27 HTTP/1.1" 200 None
2025-12-05 10:02:09 [auto1.it] INFO: Saving data for KL97300: {'auction_closing_time': 1765039858.0, 'created_time': 1762632267.37197, 'last_price_update_time': 1764928929.590697}
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL97300') HTTP/1.1" 204 0
2025-12-05 10:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d848024-40fb-5307-b82b-e360fa01d543 with identifier: GL17856
2025-12-05 10:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d848024-40fb-5307-b82b-e360fa01d543 with identifier: GL17856
2025-12-05 10:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d848024-40fb-5307-b82b-e360fa01d543 with identifier: GL17856 to the API
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL17856>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:57:57Z',
 'fuel_type': 'diesel',
 'id': '5d848024-40fb-5307-b82b-e360fa01d543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL17856',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 128676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL17856%27 HTTP/1.1" 200 None
2025-12-05 10:02:09 [auto1.it] INFO: Saving data for GL17856: {'auction_closing_time': 1765040277.0, 'created_time': 1764187374.364184, 'last_price_update_time': 1764928929.994469}
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GL17856') HTTP/1.1" 204 0
2025-12-05 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK18326> (referer: https://www.auto1.com/v1/car-details-view/GK18326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY55011> (referer: https://www.auto1.com/v1/car-details-view/GY55011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL31323> (referer: https://www.auto1.com/v1/car-details-view/PL31323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c4c90>
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg saved to cache
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c87841-b7cd-50f4-b04c-61a855a6b502 with identifier: GK18326
2025-12-05 10:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c87841-b7cd-50f4-b04c-61a855a6b502 with scrape type 1
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 69c87841-b7cd-50f4-b04c-61a855a6b502
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_3809ce9222e416bdfc6b544b77163030.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_3809ce9222e416bdfc6b544b77163030.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_320422575bb4e7debb59585c19c833e0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_320422575bb4e7debb59585c19c833e0.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_f0fc6b23d5b1032a84438f81346858f1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_f0fc6b23d5b1032a84438f81346858f1.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_7b8ed4b38f2aa70ee876b4d79b66ff26.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_7b8ed4b38f2aa70ee876b4d79b66ff26.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_230fe49a600697cf98fddc1517c6f426.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_230fe49a600697cf98fddc1517c6f426.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_ce85653d864755c892bda178fe11a0c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ce85653d864755c892bda178fe11a0c7.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_82d21d53d6dc5267032edce4b7db9621.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_82d21d53d6dc5267032edce4b7db9621.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_ed2fce687b7e51794f91cc3f13a5c446.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ed2fce687b7e51794f91cc3f13a5c446.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_b6be31c5d7b81305ffd45100ac9c46e5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b6be31c5d7b81305ffd45100ac9c46e5.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_9246b2b2ac15782f388809e14d646e0d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_9246b2b2ac15782f388809e14d646e0d.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_adc9777f46de0cad73917dfe4ec51225.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_adc9777f46de0cad73917dfe4ec51225.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_e15f240b1ee93b838486ff2347a3c6ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_e15f240b1ee93b838486ff2347a3c6ed.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_b58942e2412bcf3b0fd4d0c1849adf8d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b58942e2412bcf3b0fd4d0c1849adf8d.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_a6c662f061463bcfb1757365abe1bffe.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_a6c662f061463bcfb1757365abe1bffe.jpg already downloaded
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F98%252F8a98bf1c54868f1545db8786e48f0f0e%252Fpa%252FGK18326_940e6994afccfc0a02921b8fe521bef1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_940e6994afccfc0a02921b8fe521bef1.jpg already downloaded
2025-12-05 10:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69c87841-b7cd-50f4-b04c-61a855a6b502, identifier: GK18326
2025-12-05 10:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69c87841-b7cd-50f4-b04c-61a855a6b502 with identifier: GK18326
2025-12-05 10:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2025-12-05 10:02:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69c87841-b7cd-50f4-b04c-61a855a6b502 with identifier: GK18326
2025-12-05 10:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155140 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155140
2025-12-05 10:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 69c87841-b7cd-50f4-b04c-61a855a6b502 spider: auto1.it
2025-12-05 10:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 69c87841-b7cd-50f4-b04c-61a855a6b502 due to rule: high_mileage_for_country.json, error: 155140 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155140
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:55:43Z',
 'fuel_type': 'diesel',
 'id': '69c87841-b7cd-50f4-b04c-61a855a6b502',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK18326',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 155140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_3809ce9222e416bdfc6b544b77163030.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_320422575bb4e7debb59585c19c833e0.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_f0fc6b23d5b1032a84438f81346858f1.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_7b8ed4b38f2aa70ee876b4d79b66ff26.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_230fe49a600697cf98fddc1517c6f426.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ce85653d864755c892bda178fe11a0c7.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_82d21d53d6dc5267032edce4b7db9621.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ed2fce687b7e51794f91cc3f13a5c446.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b6be31c5d7b81305ffd45100ac9c46e5.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_9246b2b2ac15782f388809e14d646e0d.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_adc9777f46de0cad73917dfe4ec51225.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_e15f240b1ee93b838486ff2347a3c6ed.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b58942e2412bcf3b0fd4d0c1849adf8d.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_a6c662f061463bcfb1757365abe1bffe.jpg',
                'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_940e6994afccfc0a02921b8fe521bef1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_3809ce9222e416bdfc6b544b77163030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_320422575bb4e7debb59585c19c833e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_f0fc6b23d5b1032a84438f81346858f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_7b8ed4b38f2aa70ee876b4d79b66ff26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_230fe49a600697cf98fddc1517c6f426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ce85653d864755c892bda178fe11a0c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_82d21d53d6dc5267032edce4b7db9621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_ed2fce687b7e51794f91cc3f13a5c446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b6be31c5d7b81305ffd45100ac9c46e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463894,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_9246b2b2ac15782f388809e14d646e0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_adc9777f46de0cad73917dfe4ec51225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_e15f240b1ee93b838486ff2347a3c6ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_b58942e2412bcf3b0fd4d0c1849adf8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_a6c662f061463bcfb1757365abe1bffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69c87841-b7cd-50f4-b04c-61a855a6b502/69c87841-b7cd-50f4-b04c-61a855a6b502_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/98/8a98bf1c54868f1545db8786e48f0f0e/pa/GK18326_940e6994afccfc0a02921b8fe521bef1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK18326%27 HTTP/1.1" 200 None
2025-12-05 10:02:11 [auto1.it] INFO: Saving data for GK18326: {'created_time': 1764928931.354513, 'last_price_update_time': 1764928931.354523, 'auction_closing_time': 1765040143.0}
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK18326') HTTP/1.1" 204 0
2025-12-05 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b93318-ef9b-556c-a7f5-a04ffd98a213 with identifier: GY55011
2025-12-05 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b93318-ef9b-556c-a7f5-a04ffd98a213 with scrape type 2
2025-12-05 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b93318-ef9b-556c-a7f5-a04ffd98a213 with scrape type 2
2025-12-05 10:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26b93318-ef9b-556c-a7f5-a04ffd98a213, identifier: GY55011
2025-12-05 10:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0da2b565-40d1-5c79-9e53-b3143b40798f with identifier: PL31323
2025-12-05 10:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0da2b565-40d1-5c79-9e53-b3143b40798f with scrape type 2
2025-12-05 10:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0da2b565-40d1-5c79-9e53-b3143b40798f with scrape type 2
2025-12-05 10:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0da2b565-40d1-5c79-9e53-b3143b40798f, identifier: PL31323
2025-12-05 10:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26b93318-ef9b-556c-a7f5-a04ffd98a213 with identifier: GY55011
2025-12-05 10:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26b93318-ef9b-556c-a7f5-a04ffd98a213 with identifier: GY55011
2025-12-05 10:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26b93318-ef9b-556c-a7f5-a04ffd98a213 with identifier: GY55011 to the API
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY55011>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:46:16Z',
 'fuel_type': 'diesel',
 'id': '26b93318-ef9b-556c-a7f5-a04ffd98a213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY55011',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 57203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2025-12-05 10:02:12 [auto1.it] INFO: Saving data for GY55011: {'auction_closing_time': 1765039576.0, 'created_time': 1762329679.627801, 'last_price_update_time': 1764928932.069118}
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY55011') HTTP/1.1" 204 0
2025-12-05 10:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0da2b565-40d1-5c79-9e53-b3143b40798f with identifier: PL31323
2025-12-05 10:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0da2b565-40d1-5c79-9e53-b3143b40798f with identifier: PL31323
2025-12-05 10:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0da2b565-40d1-5c79-9e53-b3143b40798f with identifier: PL31323 to the API
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL31323>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:47:25Z',
 'fuel_type': 'petrol',
 'id': '0da2b565-40d1-5c79-9e53-b3143b40798f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL31323',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 29255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.5 Mild-Hybrid Cross',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2022}
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL31323%27 HTTP/1.1" 200 None
2025-12-05 10:02:12 [auto1.it] INFO: Saving data for PL31323: {'auction_closing_time': 1765039645.0, 'created_time': 1762286944.460092, 'last_price_update_time': 1764928932.537363}
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL31323') HTTP/1.1" 204 0
2025-12-05 10:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA47590> (referer: https://www.auto1.com/v1/car-details-view/BA47590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c5790>
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg saved to cache
2025-12-05 10:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f03510>
2025-12-05 10:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg saved to cache
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f433b04703f16a952f649da5f344cc29.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV43098> (referer: https://www.auto1.com/v1/car-details-view/TV43098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR35053> (referer: https://www.auto1.com/v1/car-details-view/WR35053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR91188> (referer: https://www.auto1.com/v1/car-details-view/PR91188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcd1476-5168-5fab-a141-f70744687b15 with identifier: BA47590
2025-12-05 10:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcd1476-5168-5fab-a141-f70744687b15 with scrape type 1
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_62202d0945a778dc64f65fb226df08ad.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_62202d0945a778dc64f65fb226df08ad.jpg not downloaded yet
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_db179512d952d72af5061650ee350919.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_db179512d952d72af5061650ee350919.jpg not downloaded yet
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_35f61372e90d05b99953ab6efbc27240.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_35f61372e90d05b99953ab6efbc27240.jpg not downloaded yet
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR57705> (referer: https://www.auto1.com/v1/car-details-view/NR57705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ69908> (referer: https://www.auto1.com/v1/car-details-view/PZ69908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_10261cecfa41c932cf867e588fa4d21e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_10261cecfa41c932cf867e588fa4d21e.jpg not downloaded yet
2025-12-05 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg not downloaded yet
2025-12-05 10:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU94462> (referer: https://www.auto1.com/v1/car-details-view/YU94462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fc6810>
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_f433b04703f16a952f649da5f344cc29.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f433b04703f16a952f649da5f344cc29.jpg saved to cache
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc782f53-34cc-590a-86ab-62e2465a7f9a with identifier: TV43098
2025-12-05 10:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc782f53-34cc-590a-86ab-62e2465a7f9a with scrape type 2
2025-12-05 10:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc782f53-34cc-590a-86ab-62e2465a7f9a with scrape type 2
2025-12-05 10:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc782f53-34cc-590a-86ab-62e2465a7f9a, identifier: TV43098
2025-12-05 10:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25d761b-680d-55b7-b638-f921b092fe9d with identifier: WR35053
2025-12-05 10:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25d761b-680d-55b7-b638-f921b092fe9d with scrape type 2
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25d761b-680d-55b7-b638-f921b092fe9d with scrape type 2
2025-12-05 10:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f25d761b-680d-55b7-b638-f921b092fe9d, identifier: WR35053
2025-12-05 10:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2025-12-05 10:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with scrape type 1
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg not downloaded yet
2025-12-05 10:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3dd4610>
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg saved to cache
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_0c6f795922955e17925016adb29cef7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_0c6f795922955e17925016adb29cef7c.jpg not downloaded yet
2025-12-05 10:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc782f53-34cc-590a-86ab-62e2465a7f9a with identifier: TV43098
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2025-12-05 10:02:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc782f53-34cc-590a-86ab-62e2465a7f9a with identifier: TV43098
2025-12-05 10:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc782f53-34cc-590a-86ab-62e2465a7f9a with identifier: TV43098 to the API
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV43098>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:04:14Z',
 'fuel_type': 'petrol',
 'id': 'fc782f53-34cc-590a-86ab-62e2465a7f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV43098',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 100325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 B-Color',
 'transmission': 'manual',
 'trim': 'B-Color',
 'year': 2017}
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV43098%27 HTTP/1.1" 200 None
2025-12-05 10:02:15 [auto1.it] INFO: Saving data for TV43098: {'auction_closing_time': 1765037054.0, 'created_time': 1764360394.093098, 'last_price_update_time': 1764928935.101044}
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TV43098') HTTP/1.1" 204 0
2025-12-05 10:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f25d761b-680d-55b7-b638-f921b092fe9d with identifier: WR35053
2025-12-05 10:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f25d761b-680d-55b7-b638-f921b092fe9d with identifier: WR35053
2025-12-05 10:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f25d761b-680d-55b7-b638-f921b092fe9d with identifier: WR35053 to the API
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR35053>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:30:52Z',
 'fuel_type': 'hybrid',
 'id': 'f25d761b-680d-55b7-b638-f921b092fe9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR35053',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 43300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-MMD Hybrid Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2022}
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR35053%27 HTTP/1.1" 200 None
2025-12-05 10:02:15 [auto1.it] INFO: Saving data for WR35053: {'auction_closing_time': 1765038652.0, 'created_time': 1762977739.719932, 'last_price_update_time': 1764928935.443198}
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR35053') HTTP/1.1" 204 0
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg not downloaded yet
2025-12-05 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP71679> (referer: https://www.auto1.com/v1/car-details-view/WP71679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deee8f94-14b5-5395-9a40-c55a8931767c with identifier: NR57705
2025-12-05 10:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deee8f94-14b5-5395-9a40-c55a8931767c with scrape type 1
2025-12-05 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg not downloaded yet
2025-12-05 10:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec5cac1-8e7f-5e85-804d-0174f7810400 with identifier: PZ69908
2025-12-05 10:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec5cac1-8e7f-5e85-804d-0174f7810400 with scrape type 2
2025-12-05 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aec5cac1-8e7f-5e85-804d-0174f7810400 with scrape type 2
2025-12-05 10:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aec5cac1-8e7f-5e85-804d-0174f7810400, identifier: PZ69908
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg not downloaded yet
2025-12-05 10:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH71898> (referer: https://www.auto1.com/v1/car-details-view/AH71898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aec5cac1-8e7f-5e85-804d-0174f7810400 with identifier: PZ69908
2025-12-05 10:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aec5cac1-8e7f-5e85-804d-0174f7810400 with identifier: PZ69908
2025-12-05 10:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aec5cac1-8e7f-5e85-804d-0174f7810400 with identifier: PZ69908 to the API
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ69908>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2025-12-06T16:38:10Z',
 'fuel_type': 'diesel',
 'id': 'aec5cac1-8e7f-5e85-804d-0174f7810400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ69908',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 127041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ69908%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [auto1.it] INFO: Saving data for PZ69908: {'auction_closing_time': 1765039090.0, 'created_time': 1764583335.342876, 'last_price_update_time': 1764928936.015842}
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ69908') HTTP/1.1" 204 0
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_b043f526d331d61d3dd665f6211f9818.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_b043f526d331d61d3dd665f6211f9818.jpg not downloaded yet
2025-12-05 10:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg not downloaded yet
2025-12-05 10:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2025-12-05 10:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ae9eda3-0726-503d-aca5-c9e5181a190d with scrape type 2
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ae9eda3-0726-503d-aca5-c9e5181a190d with scrape type 2
2025-12-05 10:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ae9eda3-0726-503d-aca5-c9e5181a190d, identifier: YU94462
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_f714f159575bae0b8c4d52bac38b8b31.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_f714f159575bae0b8c4d52bac38b8b31.jpg not downloaded yet
2025-12-05 10:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2025-12-05 10:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462
2025-12-05 10:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ae9eda3-0726-503d-aca5-c9e5181a190d with identifier: YU94462 to the API
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU94462>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:38:33Z',
 'fuel_type': 'petrol',
 'id': '6ae9eda3-0726-503d-aca5-c9e5181a190d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU94462',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 30857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [auto1.it] INFO: Saving data for YU94462: {'auction_closing_time': 1765039113.0, 'created_time': 1764101424.679701, 'last_price_update_time': 1764928936.600671}
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU94462') HTTP/1.1" 204 0
2025-12-05 10:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383e94ab-307b-5919-95fc-32cb0a10d4b0 with identifier: WP71679
2025-12-05 10:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383e94ab-307b-5919-95fc-32cb0a10d4b0 with scrape type 2
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383e94ab-307b-5919-95fc-32cb0a10d4b0 with scrape type 2
2025-12-05 10:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 383e94ab-307b-5919-95fc-32cb0a10d4b0, identifier: WP71679
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg not downloaded yet
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg not downloaded yet
2025-12-05 10:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 383e94ab-307b-5919-95fc-32cb0a10d4b0 with identifier: WP71679
2025-12-05 10:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 383e94ab-307b-5919-95fc-32cb0a10d4b0 with identifier: WP71679
2025-12-05 10:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2025-12-05 10:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 383e94ab-307b-5919-95fc-32cb0a10d4b0 spider: auto1.it
2025-12-05 10:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 383e94ab-307b-5919-95fc-32cb0a10d4b0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 277,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2025-12-06T16:39:55Z',
 'fuel_type': 'diesel',
 'id': '383e94ab-307b-5919-95fc-32cb0a10d4b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP71679',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 66852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71679%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [auto1.it] INFO: Saving data for WP71679: {'auction_closing_time': 1765039195.0, 'created_time': 1763755236.115805, 'last_price_update_time': 1764928937.024814}
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP71679') HTTP/1.1" 204 0
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_03040dbb18c796faad64323617260c1b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_03040dbb18c796faad64323617260c1b.jpg not downloaded yet
2025-12-05 10:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 173aaa06-77dd-5518-a89b-8aaf84212da5 with identifier: AH71898
2025-12-05 10:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 173aaa06-77dd-5518-a89b-8aaf84212da5 with scrape type 2
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 173aaa06-77dd-5518-a89b-8aaf84212da5 with scrape type 2
2025-12-05 10:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 173aaa06-77dd-5518-a89b-8aaf84212da5, identifier: AH71898
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_7b594451f7d5c6319aa02c37e5770142.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_7b594451f7d5c6319aa02c37e5770142.jpg not downloaded yet
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_e65a8c4c4c4f082cc184c5188114165a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e65a8c4c4c4f082cc184c5188114165a.jpg not downloaded yet
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR77260> (referer: https://www.auto1.com/v1/car-details-view/SR77260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS25644> (referer: https://www.auto1.com/v1/car-details-view/HS25644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 173aaa06-77dd-5518-a89b-8aaf84212da5 with identifier: AH71898
2025-12-05 10:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 173aaa06-77dd-5518-a89b-8aaf84212da5 with identifier: AH71898
2025-12-05 10:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 173aaa06-77dd-5518-a89b-8aaf84212da5 with identifier: AH71898 to the API
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH71898>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:09:47Z',
 'fuel_type': 'petrol',
 'id': '173aaa06-77dd-5518-a89b-8aaf84212da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH71898',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 23625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T-GDi Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2021}
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH71898%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [auto1.it] INFO: Saving data for AH71898: {'auction_closing_time': 1765037387.0, 'created_time': 1764187632.269804, 'last_price_update_time': 1764928937.637545}
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH71898') HTTP/1.1" 204 0
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg not downloaded yet
2025-12-05 10:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg not downloaded yet
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg not downloaded yet
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_916882163eba76b5974f8848c7f42548.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_916882163eba76b5974f8848c7f42548.jpg not downloaded yet
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK28026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:17 [scrapy.extensions.logstats] INFO: Crawled 109 pages (at 109 pages/min), scraped 24 items (at 24 items/min)
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_f41b7764b2126c38d6eeaac7f182d049.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_f41b7764b2126c38d6eeaac7f182d049.jpg not downloaded yet
2025-12-05 10:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_c71615de6204017ae5fc8bc2f018f985.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c71615de6204017ae5fc8bc2f018f985.jpg not downloaded yet
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34ba950>
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg saved to cache
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33b2950>
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg saved to cache
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d29850-e74b-53b2-aa38-4bfc0674f68a with identifier: SR77260
2025-12-05 10:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d29850-e74b-53b2-aa38-4bfc0674f68a with scrape type 2
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0d29850-e74b-53b2-aa38-4bfc0674f68a with scrape type 2
2025-12-05 10:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0d29850-e74b-53b2-aa38-4bfc0674f68a, identifier: SR77260
2025-12-05 10:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282b283e-0918-58ee-92d8-5bd9b681f453 with identifier: HS25644
2025-12-05 10:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282b283e-0918-58ee-92d8-5bd9b681f453 with scrape type 2
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282b283e-0918-58ee-92d8-5bd9b681f453 with scrape type 2
2025-12-05 10:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 282b283e-0918-58ee-92d8-5bd9b681f453, identifier: HS25644
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg not downloaded yet
2025-12-05 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL40071> (referer: https://www.auto1.com/v1/car-details-view/VL40071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ73434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0d29850-e74b-53b2-aa38-4bfc0674f68a with identifier: SR77260
2025-12-05 10:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0d29850-e74b-53b2-aa38-4bfc0674f68a with identifier: SR77260
2025-12-05 10:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0d29850-e74b-53b2-aa38-4bfc0674f68a with identifier: SR77260 to the API
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR77260>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:59:54Z',
 'fuel_type': 'diesel',
 'id': 'c0d29850-e74b-53b2-aa38-4bfc0674f68a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR77260',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 43712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Xtech ISG 2WD',
 'transmission': 'manual',
 'trim': 'Xtech ISG 2WD',
 'year': 2020}
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR77260%27 HTTP/1.1" 200 None
2025-12-05 10:02:19 [auto1.it] INFO: Saving data for SR77260: {'auction_closing_time': 1765040394.0, 'created_time': 1764619240.975424, 'last_price_update_time': 1764928939.264448}
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR77260') HTTP/1.1" 204 0
2025-12-05 10:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 282b283e-0918-58ee-92d8-5bd9b681f453 with identifier: HS25644
2025-12-05 10:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 282b283e-0918-58ee-92d8-5bd9b681f453 with identifier: HS25644
2025-12-05 10:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 282b283e-0918-58ee-92d8-5bd9b681f453 with identifier: HS25644 to the API
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS25644>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:28:45Z',
 'fuel_type': 'petrol',
 'id': '282b283e-0918-58ee-92d8-5bd9b681f453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS25644',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 68876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS25644%27 HTTP/1.1" 200 None
2025-12-05 10:02:19 [auto1.it] INFO: Saving data for HS25644: {'auction_closing_time': 1765038525.0, 'created_time': 1764101172.87944, 'last_price_update_time': 1764928939.630415}
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS25644') HTTP/1.1" 204 0
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_0c2b1b39b6d26d01fed889c52811189f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_0c2b1b39b6d26d01fed889c52811189f.jpg not downloaded yet
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_fb00ed86205da33cb66f269a650808d7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_fb00ed86205da33cb66f269a650808d7.jpg not downloaded yet
2025-12-05 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_03040dbb18c796faad64323617260c1b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_ac077d991df509da7a61ab4b5165778f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_ac077d991df509da7a61ab4b5165778f.jpg not downloaded yet
2025-12-05 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA25408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX72722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT50828> (referer: https://www.auto1.com/v1/car-details-view/NT50828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34a1310>
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg saved to cache
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30c6b50>
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg saved to cache
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_1cbd1678bd695550e10c64a205130615.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_1cbd1678bd695550e10c64a205130615.jpg not downloaded yet
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_dbb56fae2100eefecae0da1539766342.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_dbb56fae2100eefecae0da1539766342.jpg not downloaded yet
2025-12-05 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_77018c4403e85662889a4ebe95d10c53.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_06abece17bb89715e72022abdb4878fd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_06abece17bb89715e72022abdb4878fd.jpg not downloaded yet
2025-12-05 10:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089dca7c-093c-59ea-a05f-11cbf1272be6 with identifier: VL40071
2025-12-05 10:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089dca7c-093c-59ea-a05f-11cbf1272be6 with scrape type 2
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 089dca7c-093c-59ea-a05f-11cbf1272be6 with scrape type 2
2025-12-05 10:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 089dca7c-093c-59ea-a05f-11cbf1272be6, identifier: VL40071
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg not downloaded yet
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_890d1475fd6240a7252f3540e952b68f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_890d1475fd6240a7252f3540e952b68f.jpg not downloaded yet
2025-12-05 10:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 089dca7c-093c-59ea-a05f-11cbf1272be6 with identifier: VL40071
2025-12-05 10:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 089dca7c-093c-59ea-a05f-11cbf1272be6 with identifier: VL40071
2025-12-05 10:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 089dca7c-093c-59ea-a05f-11cbf1272be6 with identifier: VL40071 to the API
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL40071>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-06T16:55:07Z',
 'fuel_type': 'diesel',
 'id': '089dca7c-093c-59ea-a05f-11cbf1272be6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL40071',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 84900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL40071%27 HTTP/1.1" 200 None
2025-12-05 10:02:20 [auto1.it] INFO: Saving data for VL40071: {'auction_closing_time': 1765040107.0, 'created_time': 1764619486.957599, 'last_price_update_time': 1764928940.964193}
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL40071') HTTP/1.1" 204 0
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e92010>
2025-12-05 10:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_03040dbb18c796faad64323617260c1b.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_03040dbb18c796faad64323617260c1b.jpg saved to cache
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with identifier: NT50828
2025-12-05 10:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with scrape type 2
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with scrape type 2
2025-12-05 10:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a08d453-0bd7-5a2b-8d27-58531e2bcee0, identifier: NT50828
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg not downloaded yet
2025-12-05 10:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with identifier: NT50828
2025-12-05 10:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with identifier: NT50828
2025-12-05 10:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a08d453-0bd7-5a2b-8d27-58531e2bcee0 with identifier: NT50828 to the API
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT50828>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:03:17Z',
 'fuel_type': 'petrol',
 'id': '4a08d453-0bd7-5a2b-8d27-58531e2bcee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT50828',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 12981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT50828%27 HTTP/1.1" 200 None
2025-12-05 10:02:21 [auto1.it] INFO: Saving data for NT50828: {'auction_closing_time': 1765036997.0, 'created_time': 1764619269.571563, 'last_price_update_time': 1764928941.851291}
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NT50828') HTTP/1.1" 204 0
2025-12-05 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c71615de6204017ae5fc8bc2f018f985.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg not downloaded yet
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_cf3a79acbc0e71740118550736d9910f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_cf3a79acbc0e71740118550736d9910f.jpg not downloaded yet
2025-12-05 10:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d21c10>
2025-12-05 10:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg saved to cache
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34cec50>
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fcd%252F46cd8488ae56f5d3eced9c2338281a9d%252Fpa%252FHJ41912_77018c4403e85662889a4ebe95d10c53.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_77018c4403e85662889a4ebe95d10c53.jpg saved to cache
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45a99700-28e1-5da4-b83c-16455e009ded
2025-12-05 10:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45a99700-28e1-5da4-b83c-16455e009ded, skipping ID generation
2025-12-05 10:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a99700-28e1-5da4-b83c-16455e009ded with scrape type 1
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 45a99700-28e1-5da4-b83c-16455e009ded from tracking dictionaries
2025-12-05 10:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45a99700-28e1-5da4-b83c-16455e009ded sending to next pipeline
2025-12-05 10:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 45a99700-28e1-5da4-b83c-16455e009ded, identifier: HJ41912
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0082f50>
2025-12-05 10:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg saved to cache
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 45a99700-28e1-5da4-b83c-16455e009ded with identifier: HJ41912
2025-12-05 10:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 45a99700-28e1-5da4-b83c-16455e009ded with identifier: HJ41912
2025-12-05 10:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 45a99700-28e1-5da4-b83c-16455e009ded with identifier: HJ41912 to the API
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_77018c4403e85662889a4ebe95d10c53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:57:22Z',
 'fuel_type': 'diesel',
 'id': '45a99700-28e1-5da4-b83c-16455e009ded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ41912',
 'listing': 'auction',
 'location': 'IT, Trento',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 77677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135286,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_77018c4403e85662889a4ebe95d10c53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_06d2eacd6aa74bc7a8a5c85711a46dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_bc5adf74ce79083c8095c9f7e80bc3af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_5bb849f23a3e7bf833d20a84437398ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f433b04703f16a952f649da5f344cc29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_d4c08df77ce7cb10a55dc7e9e849792c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_efc74445a27d9c822ffa0b00f43060da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_84949d157d3d13273422b3256e429212.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f6ab3c2d81e9f929bb7d17752d89b89f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_231282ad9ecb5f624ee6e34b95a05e33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_04a0caa0ffa379e48d21409751619e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891507,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_f974d5caf6f138c2e7528501b6e91d85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_7df8684adfde72647d368b28012b1fb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_40ab7a8f37231dc1e171dac952eb169b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45a99700-28e1-5da4-b83c-16455e009ded/45a99700-28e1-5da4-b83c-16455e009ded_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/cd/46cd8488ae56f5d3eced9c2338281a9d/pa/HJ41912_e39fecbc84d81b32e1cad37db850c932.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion',
 'transmission': 'manual',
 'trim': 'Sport BlueMotion',
 'year': 2020}
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ41912%27 HTTP/1.1" 200 None
2025-12-05 10:02:23 [auto1.it] INFO: Saving data for HJ41912: {'created_time': 1764928943.558615, 'last_price_update_time': 1764928943.558626, 'auction_closing_time': 1765040242.0}
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HJ41912') HTTP/1.1" 204 0
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg not downloaded yet
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_c4e2a386b47daf55332eee1be21bcb08.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c4e2a386b47daf55332eee1be21bcb08.jpg not downloaded yet
2025-12-05 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_f41b7764b2126c38d6eeaac7f182d049.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_fb00ed86205da33cb66f269a650808d7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX48769/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f21910>
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_c71615de6204017ae5fc8bc2f018f985.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c71615de6204017ae5fc8bc2f018f985.jpg saved to cache
2025-12-05 10:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db2139110>
2025-12-05 10:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg saved to cache
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg not downloaded yet
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg not downloaded yet
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg not downloaded yet
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_3c4bcf545548daa5e849e5c4fae99021.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3c4bcf545548daa5e849e5c4fae99021.jpg not downloaded yet
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3404250>
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_f41b7764b2126c38d6eeaac7f182d049.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_f41b7764b2126c38d6eeaac7f182d049.jpg saved to cache
2025-12-05 10:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2de2810>
2025-12-05 10:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_fb00ed86205da33cb66f269a650808d7.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_fb00ed86205da33cb66f269a650808d7.jpg saved to cache
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_5a21658bd6a3ff3e405773d971c656ee.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_5a21658bd6a3ff3e405773d971c656ee.jpg not downloaded yet
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg not downloaded yet
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_0c2b1b39b6d26d01fed889c52811189f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_916882163eba76b5974f8848c7f42548.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX72722> (referer: https://www.auto1.com/v1/car-details-view/FX72722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_e33294f0b08c0aaec79872753b48fded.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e33294f0b08c0aaec79872753b48fded.jpg not downloaded yet
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_0c6f795922955e17925016adb29cef7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_35f61372e90d05b99953ab6efbc27240.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_10261cecfa41c932cf867e588fa4d21e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_f714f159575bae0b8c4d52bac38b8b31.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef2750>
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_0c2b1b39b6d26d01fed889c52811189f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_0c2b1b39b6d26d01fed889c52811189f.jpg saved to cache
2025-12-05 10:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3c4bcf545548daa5e849e5c4fae99021.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e65a8c4c4c4f082cc184c5188114165a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2de3c50>
2025-12-05 10:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_916882163eba76b5974f8848c7f42548.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_916882163eba76b5974f8848c7f42548.jpg saved to cache
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e33294f0b08c0aaec79872753b48fded.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_ac077d991df509da7a61ab4b5165778f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA25408> (referer: https://www.auto1.com/v1/car-details-view/RA25408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_cf3a79acbc0e71740118550736d9910f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with identifier: FX72722
2025-12-05 10:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with scrape type 2
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with scrape type 2
2025-12-05 10:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb7e8a7b-fc85-577f-a2ae-32217a7a7614, identifier: FX72722
2025-12-05 10:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f21e10>
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_0c6f795922955e17925016adb29cef7c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_0c6f795922955e17925016adb29cef7c.jpg saved to cache
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db008f510>
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_35f61372e90d05b99953ab6efbc27240.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_35f61372e90d05b99953ab6efbc27240.jpg saved to cache
2025-12-05 10:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bf4d0>
2025-12-05 10:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg saved to cache
2025-12-05 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f0ebd0>
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_10261cecfa41c932cf867e588fa4d21e.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_10261cecfa41c932cf867e588fa4d21e.jpg saved to cache
2025-12-05 10:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db00f16d0>
2025-12-05 10:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_f714f159575bae0b8c4d52bac38b8b31.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_f714f159575bae0b8c4d52bac38b8b31.jpg saved to cache
2025-12-05 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db01157d0>
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg saved to cache
2025-12-05 10:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with identifier: FX72722
2025-12-05 10:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with identifier: FX72722
2025-12-05 10:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb7e8a7b-fc85-577f-a2ae-32217a7a7614 with identifier: FX72722 to the API
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX72722>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2025-12-06T16:34:09Z',
 'fuel_type': 'petrol',
 'id': 'bb7e8a7b-fc85-577f-a2ae-32217a7a7614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX72722',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 87632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 PureTech So Chic',
 'transmission': 'automatic',
 'trim': 'So Chic',
 'year': 2018}
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX72722%27 HTTP/1.1" 200 None
2025-12-05 10:02:28 [auto1.it] INFO: Saving data for FX72722: {'auction_closing_time': 1765038849.0, 'created_time': 1763373876.546381, 'last_price_update_time': 1764928948.986993}
2025-12-05 10:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX72722') HTTP/1.1" 204 0
2025-12-05 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c4e2a386b47daf55332eee1be21bcb08.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34e2950>
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_3c4bcf545548daa5e849e5c4fae99021.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3c4bcf545548daa5e849e5c4fae99021.jpg saved to cache
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f4f710>
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_e65a8c4c4c4f082cc184c5188114165a.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e65a8c4c4c4f082cc184c5188114165a.jpg saved to cache
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK28026> (referer: https://www.auto1.com/v1/car-details-view/JK28026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d4df90>
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_e33294f0b08c0aaec79872753b48fded.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e33294f0b08c0aaec79872753b48fded.jpg saved to cache
2025-12-05 10:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ff9b10>
2025-12-05 10:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_ac077d991df509da7a61ab4b5165778f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_ac077d991df509da7a61ab4b5165778f.jpg saved to cache
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2025-12-05 10:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 1
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg not downloaded yet
2025-12-05 10:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fb6f90>
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_cf3a79acbc0e71740118550736d9910f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_cf3a79acbc0e71740118550736d9910f.jpg saved to cache
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e650d0>
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg saved to cache
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_a6fc6383874a2f641770e87d37221f75.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a6fc6383874a2f641770e87d37221f75.jpg not downloaded yet
2025-12-05 10:02:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db00e7150>
2025-12-05 10:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_c4e2a386b47daf55332eee1be21bcb08.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c4e2a386b47daf55332eee1be21bcb08.jpg saved to cache
2025-12-05 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c520d4-2152-5de4-a129-d672e18836a0 with identifier: JK28026
2025-12-05 10:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c520d4-2152-5de4-a129-d672e18836a0 with scrape type 2
2025-12-05 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64c520d4-2152-5de4-a129-d672e18836a0 with scrape type 2
2025-12-05 10:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64c520d4-2152-5de4-a129-d672e18836a0, identifier: JK28026
2025-12-05 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_5a21658bd6a3ff3e405773d971c656ee.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg not downloaded yet
2025-12-05 10:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64c520d4-2152-5de4-a129-d672e18836a0 with identifier: JK28026
2025-12-05 10:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64c520d4-2152-5de4-a129-d672e18836a0 with identifier: JK28026
2025-12-05 10:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145244 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145244
2025-12-05 10:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 64c520d4-2152-5de4-a129-d672e18836a0 spider: auto1.it
2025-12-05 10:02:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 64c520d4-2152-5de4-a129-d672e18836a0 due to rule: high_mileage_for_make.json, error: 145244 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145244
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-06T16:58:29Z',
 'fuel_type': 'diesel',
 'id': '64c520d4-2152-5de4-a129-d672e18836a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK28026',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 145244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2018}
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK28026%27 HTTP/1.1" 200 None
2025-12-05 10:02:31 [auto1.it] INFO: Saving data for JK28026: {'auction_closing_time': 1765040309.0, 'created_time': 1764792133.685482, 'last_price_update_time': 1764928951.964815}
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK28026') HTTP/1.1" 204 0
2025-12-05 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX48769> (referer: https://www.auto1.com/v1/car-details-view/AX48769/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_5e0d43928574c899a478fd666d8ccd74.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_5e0d43928574c899a478fd666d8ccd74.jpg not downloaded yet
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e92790>
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg saved to cache
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef6b90>
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_5a21658bd6a3ff3e405773d971c656ee.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_5a21658bd6a3ff3e405773d971c656ee.jpg saved to cache
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3406210>
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg saved to cache
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_890d1475fd6240a7252f3540e952b68f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_af67c6494e672de7fde9b97ec643630f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_af67c6494e672de7fde9b97ec643630f.jpg not downloaded yet
2025-12-05 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_dbb56fae2100eefecae0da1539766342.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_1cbd1678bd695550e10c64a205130615.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_fae49d532633c2ae2fe9a9585a138962.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_fae49d532633c2ae2fe9a9585a138962.jpg not downloaded yet
2025-12-05 10:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ73434> (referer: https://www.auto1.com/v1/car-details-view/SJ73434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3472950>
2025-12-05 10:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg saved to cache
2025-12-05 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca694328-e0ed-5405-b627-33d030f046f8 with identifier: AX48769
2025-12-05 10:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca694328-e0ed-5405-b627-33d030f046f8 with scrape type 2
2025-12-05 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca694328-e0ed-5405-b627-33d030f046f8 with scrape type 2
2025-12-05 10:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca694328-e0ed-5405-b627-33d030f046f8, identifier: AX48769
2025-12-05 10:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca694328-e0ed-5405-b627-33d030f046f8 with identifier: AX48769
2025-12-05 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca694328-e0ed-5405-b627-33d030f046f8 with identifier: AX48769
2025-12-05 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137237 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137237
2025-12-05 10:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ca694328-e0ed-5405-b627-33d030f046f8 spider: auto1.it
2025-12-05 10:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ca694328-e0ed-5405-b627-33d030f046f8 due to rule: high_mileage_for_make.json, error: 137237 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137237
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:56:29Z',
 'fuel_type': 'diesel',
 'id': 'ca694328-e0ed-5405-b627-33d030f046f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX48769',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 137237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2022}
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX48769%27 HTTP/1.1" 200 None
2025-12-05 10:02:33 [auto1.it] INFO: Saving data for AX48769: {'auction_closing_time': 1765040189.0, 'created_time': 1762286570.686029, 'last_price_update_time': 1764928953.540192}
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX48769') HTTP/1.1" 204 0
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg not downloaded yet
2025-12-05 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a6fc6383874a2f641770e87d37221f75.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_e0537eab967fb3d6fd744c534c642fb9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_e0537eab967fb3d6fd744c534c642fb9.jpg not downloaded yet
2025-12-05 10:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e024d0>
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg saved to cache
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34d5890>
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_890d1475fd6240a7252f3540e952b68f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_890d1475fd6240a7252f3540e952b68f.jpg saved to cache
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d1b490>
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_dbb56fae2100eefecae0da1539766342.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_dbb56fae2100eefecae0da1539766342.jpg saved to cache
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e000d0>
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_1cbd1678bd695550e10c64a205130615.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_1cbd1678bd695550e10c64a205130615.jpg saved to cache
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75501aa7-7886-54a2-b0e8-4369792868b9 with identifier: SJ73434
2025-12-05 10:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75501aa7-7886-54a2-b0e8-4369792868b9 with scrape type 2
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75501aa7-7886-54a2-b0e8-4369792868b9 with scrape type 2
2025-12-05 10:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75501aa7-7886-54a2-b0e8-4369792868b9, identifier: SJ73434
2025-12-05 10:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_c5ef02a7ac57570502da9d258bea5267.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_c5ef02a7ac57570502da9d258bea5267.jpg not downloaded yet
2025-12-05 10:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75501aa7-7886-54a2-b0e8-4369792868b9 with identifier: SJ73434
2025-12-05 10:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75501aa7-7886-54a2-b0e8-4369792868b9 with identifier: SJ73434
2025-12-05 10:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75501aa7-7886-54a2-b0e8-4369792868b9 with identifier: SJ73434 to the API
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ73434>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '75501aa7-7886-54a2-b0e8-4369792868b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ73434',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 84259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'manual',
 'trim': 'XLine 2WD',
 'year': 2021}
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ73434%27 HTTP/1.1" 200 None
2025-12-05 10:02:35 [auto1.it] INFO: Saving data for SJ73434: {'auction_closing_time': 1765038801.0, 'created_time': 1764014668.254294, 'last_price_update_time': 1764928955.334425}
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ73434') HTTP/1.1" 204 0
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_21712835ce294b9adc03bc35588df071.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_21712835ce294b9adc03bc35588df071.jpg not downloaded yet
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33e6110>
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg saved to cache
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f19ed0>
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_a6fc6383874a2f641770e87d37221f75.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a6fc6383874a2f641770e87d37221f75.jpg saved to cache
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_b043f526d331d61d3dd665f6211f9818.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_d81ffa641d198a225dc54a524e3de516.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d81ffa641d198a225dc54a524e3de516.jpg not downloaded yet
2025-12-05 10:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2de06d0>
2025-12-05 10:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fba%252Faeba20f29ed1ada81d6e9bd154f8277f%252Fpa%252FNR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg saved to cache
2025-12-05 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item deee8f94-14b5-5395-9a40-c55a8931767c
2025-12-05 10:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: deee8f94-14b5-5395-9a40-c55a8931767c, skipping ID generation
2025-12-05 10:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deee8f94-14b5-5395-9a40-c55a8931767c with scrape type 1
2025-12-05 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item deee8f94-14b5-5395-9a40-c55a8931767c from tracking dictionaries
2025-12-05 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item deee8f94-14b5-5395-9a40-c55a8931767c sending to next pipeline
2025-12-05 10:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: deee8f94-14b5-5395-9a40-c55a8931767c, identifier: NR57705
2025-12-05 10:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: deee8f94-14b5-5395-9a40-c55a8931767c with identifier: NR57705
2025-12-05 10:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: deee8f94-14b5-5395-9a40-c55a8931767c with identifier: NR57705
2025-12-05 10:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: deee8f94-14b5-5395-9a40-c55a8931767c with identifier: NR57705 to the API
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2025-12-06T16:52:31Z',
 'fuel_type': 'diesel',
 'id': 'deee8f94-14b5-5395-9a40-c55a8931767c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR57705',
 'listing': 'auction',
 'location': 'IT, Sassari',
 'make': 'BMW',
 'model': '7er',
 'odometer': 83705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299072,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_bfd00f0bb4e2da4b7517cb3a286dc7f4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281530,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_7565a83e60b9cc1ccc9c2f4c44f90a8e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265891,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_ccae5c8b6bc0c6816960fbc336591dd7.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e65a8c4c4c4f082cc184c5188114165a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3774a7100d8e9bafbca21fd97038fb6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c71615de6204017ae5fc8bc2f018f985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_fb00ed86205da33cb66f269a650808d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_dbb56fae2100eefecae0da1539766342.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280443,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_890d1475fd6240a7252f3540e952b68f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248864,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_cf3a79acbc0e71740118550736d9910f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324223,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_c4e2a386b47daf55332eee1be21bcb08.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305212,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_20acde3364cd7ab46e10bb5bab61bba5.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_3c4bcf545548daa5e849e5c4fae99021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313888,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_5d967db2cd77c47f4f451dfe96fbe50c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deee8f94-14b5-5395-9a40-c55a8931767c/deee8f94-14b5-5395-9a40-c55a8931767c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/ba/aeba20f29ed1ada81d6e9bd154f8277f/pa/NR57705_e33294f0b08c0aaec79872753b48fded.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 730d Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2021}
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR57705%27 HTTP/1.1" 200 None
2025-12-05 10:02:36 [auto1.it] INFO: Saving data for NR57705: {'created_time': 1764928956.889922, 'last_price_update_time': 1764928956.889933, 'auction_closing_time': 1765039951.0}
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR57705') HTTP/1.1" 204 0
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_03bcca552c6b649624f403e6efeafc14.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_03bcca552c6b649624f403e6efeafc14.jpg not downloaded yet
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3db9190>
2025-12-05 10:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_b043f526d331d61d3dd665f6211f9818.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_b043f526d331d61d3dd665f6211f9818.jpg saved to cache
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3dbbcd0>
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg saved to cache
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_5e0d43928574c899a478fd666d8ccd74.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg not downloaded yet
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_8936e98d2a0fa0a26df75af76c19262a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_8936e98d2a0fa0a26df75af76c19262a.jpg not downloaded yet
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg not downloaded yet
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30206d0>
2025-12-05 10:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg saved to cache
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3022ad0>
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_5e0d43928574c899a478fd666d8ccd74.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_5e0d43928574c899a478fd666d8ccd74.jpg saved to cache
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_db179512d952d72af5061650ee350919.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_af67c6494e672de7fde9b97ec643630f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_06abece17bb89715e72022abdb4878fd.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_7b594451f7d5c6319aa02c37e5770142.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_03bcca552c6b649624f403e6efeafc14.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_62202d0945a778dc64f65fb226df08ad.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30ccdd0>
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg saved to cache
2025-12-05 10:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_8936e98d2a0fa0a26df75af76c19262a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_21712835ce294b9adc03bc35588df071.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_fae49d532633c2ae2fe9a9585a138962.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d81ffa641d198a225dc54a524e3de516.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0101550>
2025-12-05 10:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_db179512d952d72af5061650ee350919.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_db179512d952d72af5061650ee350919.jpg saved to cache
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eae310>
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_af67c6494e672de7fde9b97ec643630f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_af67c6494e672de7fde9b97ec643630f.jpg saved to cache
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0080310>
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg saved to cache
2025-12-05 10:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d20ad0>
2025-12-05 10:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_06abece17bb89715e72022abdb4878fd.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_06abece17bb89715e72022abdb4878fd.jpg saved to cache
2025-12-05 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34ce1d0>
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg saved to cache
2025-12-05 10:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0102950>
2025-12-05 10:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fec%252F3aec9bede5854b5d793453a4b5a132c5%252Fpa%252FPR91188_7b594451f7d5c6319aa02c37e5770142.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_7b594451f7d5c6319aa02c37e5770142.jpg saved to cache
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5
2025-12-05 10:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5, skipping ID generation
2025-12-05 10:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with scrape type 1
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 from tracking dictionaries
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 sending to next pipeline
2025-12-05 10:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5, identifier: PR91188
2025-12-05 10:02:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30cf110>
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg saved to cache
2025-12-05 10:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34ce790>
2025-12-05 10:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_03bcca552c6b649624f403e6efeafc14.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_03bcca552c6b649624f403e6efeafc14.jpg saved to cache
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da332b690>
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F90%252F2790e67caa8eee28641a676f2cd6f194%252Fpa%252FBA47590_62202d0945a778dc64f65fb226df08ad.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_62202d0945a778dc64f65fb226df08ad.jpg saved to cache
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afcd1476-5168-5fab-a141-f70744687b15
2025-12-05 10:02:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afcd1476-5168-5fab-a141-f70744687b15, skipping ID generation
2025-12-05 10:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcd1476-5168-5fab-a141-f70744687b15 with scrape type 1
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item afcd1476-5168-5fab-a141-f70744687b15 from tracking dictionaries
2025-12-05 10:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afcd1476-5168-5fab-a141-f70744687b15 sending to next pipeline
2025-12-05 10:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afcd1476-5168-5fab-a141-f70744687b15, identifier: BA47590
2025-12-05 10:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2025-12-05 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2025-12-05 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168306
2025-12-05 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 spider: auto1.it
2025-12-05 10:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 due to rule: high_mileage_for_country.json, error: 168306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168306
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-06T16:00:44Z',
 'fuel_type': 'petrol',
 'id': 'fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR91188',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 168306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_ed0d3ca3b7f94d3c136461fb893e9111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a0f11e663e5a385b38b05a89fc0aa19c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_b043f526d331d61d3dd665f6211f9818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_66f51b00d7aafb64cfd4112c9ff43cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2263432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_7b594451f7d5c6319aa02c37e5770142.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a4f7bf8e5cf311e5a169e591588d68fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_f41b7764b2126c38d6eeaac7f182d049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_0c2b1b39b6d26d01fed889c52811189f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_1cbd1678bd695550e10c64a205130615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_4b00ded661b973e19e19655c5f9bf9c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_8c4f39e7bbaea718b0bbe99086788a9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_60d50c968ef79e75ee1acb7abb004fb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_a1b3eaad56ef71669d2e01c4bb449c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_e16a0528638452da4bdb1939f1e6a2ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5/fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/ec/3aec9bede5854b5d793453a4b5a132c5/pa/PR91188_5a21658bd6a3ff3e405773d971c656ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2025-12-05 10:02:42 [auto1.it] INFO: Saving data for PR91188: {'created_time': 1764928962.78684, 'last_price_update_time': 1764928962.786855, 'auction_closing_time': 1765036844.0}
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR91188') HTTP/1.1" 204 0
2025-12-05 10:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afcd1476-5168-5fab-a141-f70744687b15 with identifier: BA47590
2025-12-05 10:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afcd1476-5168-5fab-a141-f70744687b15 with identifier: BA47590
2025-12-05 10:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afcd1476-5168-5fab-a141-f70744687b15 with identifier: BA47590 to the API
2025-12-05 10:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_62202d0945a778dc64f65fb226df08ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:07:26Z',
 'fuel_type': 'diesel',
 'id': 'afcd1476-5168-5fab-a141-f70744687b15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA47590',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 121330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_62202d0945a778dc64f65fb226df08ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_db179512d952d72af5061650ee350919.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_35f61372e90d05b99953ab6efbc27240.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3207947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_10261cecfa41c932cf867e588fa4d21e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_5839bb9fe8ad0153b256275df8aa9e3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_0c6f795922955e17925016adb29cef7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_380dcd6c4f07c037ecd7e606e3b1822c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_f714f159575bae0b8c4d52bac38b8b31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_03040dbb18c796faad64323617260c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641874,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_1ffb5c1fa1c4144fe69fab232750acf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_916882163eba76b5974f8848c7f42548.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2293901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_7930c82b2094e2a2a0040742a7aa3a0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_ac077d991df509da7a61ab4b5165778f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2278769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_06abece17bb89715e72022abdb4878fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcd1476-5168-5fab-a141-f70744687b15/afcd1476-5168-5fab-a141-f70744687b15_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/90/2790e67caa8eee28641a676f2cd6f194/pa/BA47590_2ba4f0477cf0a885f5136d95a57f5e31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2019}
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA47590%27 HTTP/1.1" 200 None
2025-12-05 10:02:43 [auto1.it] INFO: Saving data for BA47590: {'created_time': 1764928963.279608, 'last_price_update_time': 1764928963.279619, 'auction_closing_time': 1765037246.0}
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA47590') HTTP/1.1" 204 0
2025-12-05 10:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fb7510>
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_8936e98d2a0fa0a26df75af76c19262a.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_8936e98d2a0fa0a26df75af76c19262a.jpg saved to cache
2025-12-05 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da332f950>
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_21712835ce294b9adc03bc35588df071.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_21712835ce294b9adc03bc35588df071.jpg saved to cache
2025-12-05 10:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db00e67d0>
2025-12-05 10:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg saved to cache
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33bbb50>
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg saved to cache
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fa1110>
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_fae49d532633c2ae2fe9a9585a138962.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_fae49d532633c2ae2fe9a9585a138962.jpg saved to cache
2025-12-05 10:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e382d0>
2025-12-05 10:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_d81ffa641d198a225dc54a524e3de516.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d81ffa641d198a225dc54a524e3de516.jpg saved to cache
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db1f26e50>
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg saved to cache
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_383b02af92fa42ff822484feb598d41a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_c5ef02a7ac57570502da9d258bea5267.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_e0537eab967fb3d6fd744c534c642fb9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da332d550>
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg saved to cache
2025-12-05 10:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_16b33338ae3e028598e2c05896fb5d3a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5258392b312ccb50b76516afe9a963e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_527ac36b67b13cea1380f091d8397082.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da304ce50>
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg saved to cache
2025-12-05 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f5ca50>
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_383b02af92fa42ff822484feb598d41a.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_383b02af92fa42ff822484feb598d41a.jpg saved to cache
2025-12-05 10:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d5bc50>
2025-12-05 10:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg saved to cache
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da304f4d0>
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg saved to cache
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ead210>
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_c5ef02a7ac57570502da9d258bea5267.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_c5ef02a7ac57570502da9d258bea5267.jpg saved to cache
2025-12-05 10:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da303fc50>
2025-12-05 10:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fda%252F0ddabc232024aa286979fa60ce464505%252Fpa%252FRA25408_e0537eab967fb3d6fd744c534c642fb9.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_e0537eab967fb3d6fd744c534c642fb9.jpg saved to cache
2025-12-05 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 741d7026-0aac-5c3b-8af5-ab758388ede6
2025-12-05 10:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 741d7026-0aac-5c3b-8af5-ab758388ede6, skipping ID generation
2025-12-05 10:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 1
2025-12-05 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 741d7026-0aac-5c3b-8af5-ab758388ede6 from tracking dictionaries
2025-12-05 10:02:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 741d7026-0aac-5c3b-8af5-ab758388ede6 sending to next pipeline
2025-12-05 10:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 741d7026-0aac-5c3b-8af5-ab758388ede6, identifier: RA25408
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fa0d10>
2025-12-05 10:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg saved to cache
2025-12-05 10:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2025-12-05 10:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2025-12-05 10:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408 to the API
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_e0537eab967fb3d6fd744c534c642fb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:09:29Z',
 'fuel_type': 'hybrid',
 'id': '741d7026-0aac-5c3b-8af5-ab758388ede6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA25408',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 81577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_b58ecb979bec2b5ccd4e77d81ff0add5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a6fc6383874a2f641770e87d37221f75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2942895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_a13eb638c9036d371bde3bdbc5f2627f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_5e0d43928574c899a478fd666d8ccd74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_af67c6494e672de7fde9b97ec643630f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_fae49d532633c2ae2fe9a9585a138962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_f2f2b4c1b7948d87df7e14c5353cf2d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3227914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_e0537eab967fb3d6fd744c534c642fb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_c5ef02a7ac57570502da9d258bea5267.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_21712835ce294b9adc03bc35588df071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d81ffa641d198a225dc54a524e3de516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_03bcca552c6b649624f403e6efeafc14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_d807d50ffe56d3dad91922d1e4930aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_8936e98d2a0fa0a26df75af76c19262a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_741d7026-0aac-5c3b-8af5-ab758388ede6/741d7026-0aac-5c3b-8af5-ab758388ede6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/da/0ddabc232024aa286979fa60ce464505/pa/RA25408_81a00ce6bfbb1bcb137d40bd28c9d859.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2025-12-05 10:02:49 [auto1.it] INFO: Saving data for RA25408: {'created_time': 1764928969.686775, 'last_price_update_time': 1764928969.686784, 'auction_closing_time': 1765037369.0}
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA25408') HTTP/1.1" 204 0
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f55790>
2025-12-05 10:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_16b33338ae3e028598e2c05896fb5d3a.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_16b33338ae3e028598e2c05896fb5d3a.jpg saved to cache
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c2750>
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_5258392b312ccb50b76516afe9a963e2.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5258392b312ccb50b76516afe9a963e2.jpg saved to cache
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ed7a10>
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_527ac36b67b13cea1380f091d8397082.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_527ac36b67b13cea1380f091d8397082.jpg saved to cache
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF54996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ75432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL58334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW00442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE23959> (referer: https://www.auto1.com/v1/car-details-view/VE23959/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ06005> (referer: https://www.auto1.com/v1/car-details-view/FJ06005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA23439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK99517> (referer: https://www.auto1.com/v1/car-details-view/HK99517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_bb266d77354597452d045b2b123e3bd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_65c07b445e29d5b4b971091fc92532c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a with identifier: VE23959
2025-12-05 10:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bde1142e-cefe-5abf-9aa1-c6d28dc37c9a with scrape type 2
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bde1142e-cefe-5abf-9aa1-c6d28dc37c9a with scrape type 2
2025-12-05 10:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a, identifier: VE23959
2025-12-05 10:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3518fb69-f639-5d38-a832-cceeb26b9d57 with identifier: FJ06005
2025-12-05 10:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3518fb69-f639-5d38-a832-cceeb26b9d57 with scrape type 2
2025-12-05 10:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3518fb69-f639-5d38-a832-cceeb26b9d57 with scrape type 2
2025-12-05 10:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3518fb69-f639-5d38-a832-cceeb26b9d57, identifier: FJ06005
2025-12-05 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a with identifier: VE23959
2025-12-05 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a with identifier: VE23959
2025-12-05 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175621 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175621
2025-12-05 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a spider: auto1.it
2025-12-05 10:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: bde1142e-cefe-5abf-9aa1-c6d28dc37c9a due to rule: high_mileage_for_country.json, error: 175621 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175621
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:38:51Z',
 'fuel_type': 'diesel',
 'id': 'bde1142e-cefe-5abf-9aa1-c6d28dc37c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE23959',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 175621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23959%27 HTTP/1.1" 200 None
2025-12-05 10:02:51 [auto1.it] INFO: Saving data for VE23959: {'auction_closing_time': 1765039131.0, 'created_time': 1764151467.331959, 'last_price_update_time': 1764928971.335636}
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VE23959') HTTP/1.1" 204 0
2025-12-05 10:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3518fb69-f639-5d38-a832-cceeb26b9d57 with identifier: FJ06005
2025-12-05 10:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3518fb69-f639-5d38-a832-cceeb26b9d57 with identifier: FJ06005
2025-12-05 10:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3518fb69-f639-5d38-a832-cceeb26b9d57 with identifier: FJ06005 to the API
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ06005>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-06T16:29:58Z',
 'fuel_type': 'petrol',
 'id': '3518fb69-f639-5d38-a832-cceeb26b9d57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ06005',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 31803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ06005%27 HTTP/1.1" 200 None
2025-12-05 10:02:51 [auto1.it] INFO: Saving data for FJ06005: {'auction_closing_time': 1765038598.0, 'created_time': 1763496447.42304, 'last_price_update_time': 1764928971.743904}
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ06005') HTTP/1.1" 204 0
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_9f455f82bf417b0904fea93dd00133b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_692ea8f891b37339c075b413bcba8fbe.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13223fd8-0e4c-54cd-b26e-91845e692775 with identifier: HK99517
2025-12-05 10:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13223fd8-0e4c-54cd-b26e-91845e692775 with scrape type 2
2025-12-05 10:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13223fd8-0e4c-54cd-b26e-91845e692775 with scrape type 2
2025-12-05 10:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13223fd8-0e4c-54cd-b26e-91845e692775, identifier: HK99517
2025-12-05 10:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33e29d0>
2025-12-05 10:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_bb266d77354597452d045b2b123e3bd2.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_bb266d77354597452d045b2b123e3bd2.jpg saved to cache
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3440810>
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F78%252Fbd783d2fd81f41a5dbdda9a288ef6828%252Fpa%252FVC15386_65c07b445e29d5b4b971091fc92532c9.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_65c07b445e29d5b4b971091fc92532c9.jpg saved to cache
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fe99905-733d-5362-8e94-527876efd821
2025-12-05 10:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fe99905-733d-5362-8e94-527876efd821, skipping ID generation
2025-12-05 10:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe99905-733d-5362-8e94-527876efd821 with scrape type 1
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5fe99905-733d-5362-8e94-527876efd821 from tracking dictionaries
2025-12-05 10:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fe99905-733d-5362-8e94-527876efd821 sending to next pipeline
2025-12-05 10:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5fe99905-733d-5362-8e94-527876efd821, identifier: VC15386
2025-12-05 10:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13223fd8-0e4c-54cd-b26e-91845e692775 with identifier: HK99517
2025-12-05 10:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13223fd8-0e4c-54cd-b26e-91845e692775 with identifier: HK99517
2025-12-05 10:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13223fd8-0e4c-54cd-b26e-91845e692775 with identifier: HK99517 to the API
2025-12-05 10:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK99517>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:24:36Z',
 'fuel_type': 'petrol',
 'id': '13223fd8-0e4c-54cd-b26e-91845e692775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK99517',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 98254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2017}
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK99517%27 HTTP/1.1" 200 None
2025-12-05 10:02:53 [auto1.it] INFO: Saving data for HK99517: {'auction_closing_time': 1765038276.0, 'created_time': 1763236899.97072, 'last_price_update_time': 1764928973.159015}
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK99517') HTTP/1.1" 204 0
2025-12-05 10:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5fe99905-733d-5362-8e94-527876efd821 with identifier: VC15386
2025-12-05 10:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5fe99905-733d-5362-8e94-527876efd821 with identifier: VC15386
2025-12-05 10:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5fe99905-733d-5362-8e94-527876efd821 with identifier: VC15386 to the API
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_65c07b445e29d5b4b971091fc92532c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 194,
 'expiration_date': '2025-12-06T16:50:43Z',
 'fuel_type': 'diesel',
 'id': '5fe99905-733d-5362-8e94-527876efd821',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC15386',
 'listing': 'auction',
 'location': 'IT, Treviolo',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 82786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_65c07b445e29d5b4b971091fc92532c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_b59875e3999f882e208c30c0f61a00dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_5db217aadec7408ece23d6f19ea90402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_16dce74ef1a2d9f8b3ac257124426fba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e6af59b7fbd30cc545fc12ed61e4991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_810129b9a1baf61de4f2157c72915fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_156227aec9a8b1dbbdc69521b47d94e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_a30e3dea1f6053ae954a88e3d5470eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f31f825e1d0a0d58b1a58625d5e5cb71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f2b26e7f6881e2d76f6d40f06f8bc2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6d519bc5a13487080132494967f5b4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_6f58446a6c44e583997d606139083908.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_f6cc63448549bd322fd6e5f6cfd48d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_83040ec2a4ac71b452ff8a86e988b515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe99905-733d-5362-8e94-527876efd821/5fe99905-733d-5362-8e94-527876efd821_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/78/bd783d2fd81f41a5dbdda9a288ef6828/pa/VC15386_2e5e110a5cf68190b5df5a3a9773aced.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Overland 4x4',
 'transmission': 'automatic',
 'trim': 'Overland 4x4',
 'year': 2018}
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC15386%27 HTTP/1.1" 200 None
2025-12-05 10:02:53 [auto1.it] INFO: Saving data for VC15386: {'created_time': 1764928973.594328, 'last_price_update_time': 1764928973.59434, 'auction_closing_time': 1765039843.0}
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC15386') HTTP/1.1" 204 0
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fd2c50>
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg saved to cache
2025-12-05 10:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fd2850>
2025-12-05 10:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_9f455f82bf417b0904fea93dd00133b2.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_9f455f82bf417b0904fea93dd00133b2.jpg saved to cache
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3445750>
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_692ea8f891b37339c075b413bcba8fbe.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_692ea8f891b37339c075b413bcba8fbe.jpg saved to cache
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f0f6d0>
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg saved to cache
2025-12-05 10:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3085010>
2025-12-05 10:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg saved to cache
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db008de10>
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg saved to cache
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_b702448b7c4ed6c0dfd923aff928497f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ01897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH45068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW22031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE49943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD81765> (referer: https://www.auto1.com/v1/car-details-view/ZD81765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL72110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG92403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_cd21a720f4e3fb9122735b4c5c235823.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d666843562b708c37c5548a990773d1d.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e2c9d0>
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F8f%252Fc38fd5492d0705cd4c8b437fb43d4c36%252Fpa%252FET69772_b702448b7c4ed6c0dfd923aff928497f.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_b702448b7c4ed6c0dfd923aff928497f.jpg saved to cache
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31a223cf-4a21-5702-b32e-7c76660f9b02
2025-12-05 10:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31a223cf-4a21-5702-b32e-7c76660f9b02, skipping ID generation
2025-12-05 10:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a223cf-4a21-5702-b32e-7c76660f9b02 with scrape type 1
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 31a223cf-4a21-5702-b32e-7c76660f9b02 from tracking dictionaries
2025-12-05 10:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31a223cf-4a21-5702-b32e-7c76660f9b02 sending to next pipeline
2025-12-05 10:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 31a223cf-4a21-5702-b32e-7c76660f9b02, identifier: ET69772
2025-12-05 10:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 31a223cf-4a21-5702-b32e-7c76660f9b02 with identifier: ET69772
2025-12-05 10:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 31a223cf-4a21-5702-b32e-7c76660f9b02 with identifier: ET69772
2025-12-05 10:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156962
2025-12-05 10:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 31a223cf-4a21-5702-b32e-7c76660f9b02 spider: auto1.it
2025-12-05 10:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 31a223cf-4a21-5702-b32e-7c76660f9b02 due to rule: high_mileage_for_country.json, error: 156962 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156962
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:21:52Z',
 'fuel_type': 'diesel',
 'id': '31a223cf-4a21-5702-b32e-7c76660f9b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET69772',
 'listing': 'auction',
 'location': 'IT, Foggia',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 156962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5459886c185385847cc59cb0c35c6509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8c6b178355ad0ad60ddacdafc1d07d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_b702448b7c4ed6c0dfd923aff928497f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_1eb659cc64e5c7a0d55c65a34988d895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_692ea8f891b37339c075b413bcba8fbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_a8e6cbbe8445db2d83d793073519a0a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_9f455f82bf417b0904fea93dd00133b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f3e81ff19062e7c44ffb82801f69c4d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_527ac36b67b13cea1380f091d8397082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_5258392b312ccb50b76516afe9a963e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_52fa024c217f0b0aff47540dd2a1834c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_c8d08ba77a9a80cbfe6a9e7b73616d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_f5c603f750f650a02e6a130d17e8a317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_383b02af92fa42ff822484feb598d41a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31a223cf-4a21-5702-b32e-7c76660f9b02/31a223cf-4a21-5702-b32e-7c76660f9b02_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/8f/c38fd5492d0705cd4c8b437fb43d4c36/pa/ET69772_3792c74b314f40de319eda9fc0dd8b61.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET69772%27 HTTP/1.1" 200 None
2025-12-05 10:02:56 [auto1.it] INFO: Saving data for ET69772: {'created_time': 1764928976.274928, 'last_price_update_time': 1764928976.274941, 'auction_closing_time': 1765038112.0}
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET69772') HTTP/1.1" 204 0
2025-12-05 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_d4d4760d4b2da2523944dbd8579488ae.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a65b70f-5022-56ac-bad3-f3a8358caff8 with identifier: ZD81765
2025-12-05 10:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a65b70f-5022-56ac-bad3-f3a8358caff8 with scrape type 2
2025-12-05 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a65b70f-5022-56ac-bad3-f3a8358caff8 with scrape type 2
2025-12-05 10:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a65b70f-5022-56ac-bad3-f3a8358caff8, identifier: ZD81765
2025-12-05 10:02:56 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3dcfdd0>
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg saved to cache
2025-12-05 10:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da348dc10>
2025-12-05 10:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg saved to cache
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e19710>
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_cd21a720f4e3fb9122735b4c5c235823.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_cd21a720f4e3fb9122735b4c5c235823.jpg saved to cache
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d9fdd0>
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_d666843562b708c37c5548a990773d1d.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d666843562b708c37c5548a990773d1d.jpg saved to cache
2025-12-05 10:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a65b70f-5022-56ac-bad3-f3a8358caff8 with identifier: ZD81765
2025-12-05 10:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a65b70f-5022-56ac-bad3-f3a8358caff8 with identifier: ZD81765
2025-12-05 10:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a65b70f-5022-56ac-bad3-f3a8358caff8 with identifier: ZD81765 to the API
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD81765>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-06T16:41:50Z',
 'fuel_type': 'diesel',
 'id': '8a65b70f-5022-56ac-bad3-f3a8358caff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD81765',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 146013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Energy 2WD',
 'transmission': 'automatic',
 'trim': 'Energy 2WD',
 'year': 2019}
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD81765%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Saving data for ZD81765: {'auction_closing_time': 1765039310.0, 'created_time': 1764187725.792979, 'last_price_update_time': 1764928978.374544}
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD81765') HTTP/1.1" 204 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: UL79452
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL79452%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for UL79452: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: DB84846
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB84846%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for DB84846: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: XV69767
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV69767%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for XV69767: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: MP22831
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP22831%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for MP22831: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: XV25208
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for XV25208: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: VK82687
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK82687%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for VK82687: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: ZW50433
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW50433%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for ZW50433: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: XP38674
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38674%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for XP38674: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: LC91200
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC91200%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for LC91200: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: YC62647
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC62647%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for YC62647: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: GU84869
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU84869%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for GU84869: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: UA54226
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54226%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for UA54226: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: HL50165
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL50165%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for HL50165: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: SA69794
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA69794%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for SA69794: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: PR47123
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR47123%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for PR47123: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: RU07739
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for RU07739: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: XW61885
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW61885%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for XW61885: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: RY32891
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY32891%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for RY32891: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: BJ61163
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ61163%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for BJ61163: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: JE29882
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE29882%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for JE29882: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: LY02966
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY02966%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for LY02966: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: FT49386
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT49386%27 HTTP/1.1" 200 None
2025-12-05 10:02:58 [auto1.it] INFO: Scrape type for FT49386: 0
2025-12-05 10:02:58 [auto1.it] INFO: Found listing with ID: MZ03100
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ03100%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for MZ03100: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: PM67896
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM67896%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for PM67896: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: TW96675
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW96675%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for TW96675: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: TK05745
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK05745%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for TK05745: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: AM48231
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM48231%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for AM48231: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: BY71307
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY71307%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for BY71307: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: EV89317
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV89317%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for EV89317: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: FB33049
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB33049%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for FB33049: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: NG26888
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG26888%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for NG26888: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: NP33757
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33757%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for NP33757: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: MY56482
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY56482%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for MY56482: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: MR53834
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR53834%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for MR53834: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: HY82993
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82993%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for HY82993: 0
2025-12-05 10:02:59 [auto1.it] INFO: Found listing with ID: KS83766
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS83766%27 HTTP/1.1" 200 None
2025-12-05 10:02:59 [auto1.it] INFO: Scrape type for KS83766: 2
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3087b50>
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg saved to cache
2025-12-05 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30ce110>
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg') HTTP/1.1" 204 0
2025-12-05 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg saved to cache
2025-12-05 10:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f4ced0>
2025-12-05 10:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg saved to cache
2025-12-05 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33e4950>
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_d4d4760d4b2da2523944dbd8579488ae.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_d4d4760d4b2da2523944dbd8579488ae.jpg saved to cache
2025-12-05 10:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d6fe6491c6f142c05251574c99bd7a40.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:00 [auto1.it] INFO: Found listing with ID: GZ35753
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ35753%27 HTTP/1.1" 200 None
2025-12-05 10:03:00 [auto1.it] INFO: Scrape type for GZ35753: 0
2025-12-05 10:03:00 [auto1.it] INFO: Found listing with ID: WF16384
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF16384%27 HTTP/1.1" 200 None
2025-12-05 10:03:00 [auto1.it] INFO: Scrape type for WF16384: 0
2025-12-05 10:03:00 [auto1.it] INFO: Found listing with ID: BS85583
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS85583%27 HTTP/1.1" 200 None
2025-12-05 10:03:00 [auto1.it] INFO: Scrape type for BS85583: 0
2025-12-05 10:03:00 [auto1.it] INFO: Found listing with ID: RG96613
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG96613%27 HTTP/1.1" 200 None
2025-12-05 10:03:00 [auto1.it] INFO: Scrape type for RG96613: 0
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_aecf187df633434e0cef9f6c11d158a2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP36603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW00442> (referer: https://www.auto1.com/v1/car-details-view/VW00442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL58334> (referer: https://www.auto1.com/v1/car-details-view/XL58334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF54996> (referer: https://www.auto1.com/v1/car-details-view/AF54996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA23439> (referer: https://www.auto1.com/v1/car-details-view/CA23439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA12776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ75432> (referer: https://www.auto1.com/v1/car-details-view/YZ75432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db011afd0>
2025-12-05 10:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d6fe6491c6f142c05251574c99bd7a40.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d6fe6491c6f142c05251574c99bd7a40.jpg saved to cache
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ead790>
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_aecf187df633434e0cef9f6c11d158a2.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_aecf187df633434e0cef9f6c11d158a2.jpg saved to cache
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da307aa90>
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg saved to cache
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0883c2db-d86e-5640-b0f8-0ee7c217d154 with identifier: VW00442
2025-12-05 10:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0883c2db-d86e-5640-b0f8-0ee7c217d154 with scrape type 2
2025-12-05 10:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0883c2db-d86e-5640-b0f8-0ee7c217d154 with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0883c2db-d86e-5640-b0f8-0ee7c217d154, identifier: VW00442
2025-12-05 10:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247acb80-997d-529c-8a08-8536dc03845f with identifier: XL58334
2025-12-05 10:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247acb80-997d-529c-8a08-8536dc03845f with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247acb80-997d-529c-8a08-8536dc03845f with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 247acb80-997d-529c-8a08-8536dc03845f, identifier: XL58334
2025-12-05 10:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a97674af-aa79-5754-9095-90ff1fc5b258 with identifier: AF54996
2025-12-05 10:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a97674af-aa79-5754-9095-90ff1fc5b258 with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a97674af-aa79-5754-9095-90ff1fc5b258 with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a97674af-aa79-5754-9095-90ff1fc5b258, identifier: AF54996
2025-12-05 10:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aab090a-8b78-5c21-82dd-9c185fd99f9c with identifier: CA23439
2025-12-05 10:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aab090a-8b78-5c21-82dd-9c185fd99f9c with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aab090a-8b78-5c21-82dd-9c185fd99f9c with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0aab090a-8b78-5c21-82dd-9c185fd99f9c, identifier: CA23439
2025-12-05 10:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with identifier: YZ75432
2025-12-05 10:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with scrape type 2
2025-12-05 10:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10147ac9-ae36-5e8b-bfae-7b4bf146f01f, identifier: YZ75432
2025-12-05 10:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0883c2db-d86e-5640-b0f8-0ee7c217d154 with identifier: VW00442
2025-12-05 10:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0883c2db-d86e-5640-b0f8-0ee7c217d154 with identifier: VW00442
2025-12-05 10:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0883c2db-d86e-5640-b0f8-0ee7c217d154 with identifier: VW00442 to the API
2025-12-05 10:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%270883c2db-d86e-5640-b0f8-0ee7c217d154%27 HTTP/1.1" 200 None
2025-12-05 10:03:04 [crawlers.pipelines.post_to_api] ERROR: auto1.it, item_id 0883c2db-d86e-5640-b0f8-0ee7c217d154: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 10:03:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 10:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW00442>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2025-12-06T16:17:15Z',
 'fuel_type': 'petrol',
 'id': '0883c2db-d86e-5640-b0f8-0ee7c217d154',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW00442',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 63446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW00442%27 HTTP/1.1" 200 None
2025-12-05 10:03:04 [auto1.it] INFO: Saving data for VW00442: {'auction_closing_time': 1765037835.0, 'created_time': 1762286476.057034, 'last_price_update_time': 1764928984.187211}
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VW00442') HTTP/1.1" 204 0
2025-12-05 10:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 247acb80-997d-529c-8a08-8536dc03845f with identifier: XL58334
2025-12-05 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 247acb80-997d-529c-8a08-8536dc03845f with identifier: XL58334
2025-12-05 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157151 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157151
2025-12-05 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 247acb80-997d-529c-8a08-8536dc03845f spider: auto1.it
2025-12-05 10:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 247acb80-997d-529c-8a08-8536dc03845f due to rule: high_mileage_for_country.json, error: 157151 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157151
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-06T16:54:56Z',
 'fuel_type': 'diesel',
 'id': '247acb80-997d-529c-8a08-8536dc03845f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL58334',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 157151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2017}
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL58334%27 HTTP/1.1" 200 None
2025-12-05 10:03:04 [auto1.it] INFO: Saving data for XL58334: {'auction_closing_time': 1765040096.0, 'created_time': 1764187525.633474, 'last_price_update_time': 1764928984.649837}
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL58334') HTTP/1.1" 204 0
2025-12-05 10:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a97674af-aa79-5754-9095-90ff1fc5b258 with identifier: AF54996
2025-12-05 10:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a97674af-aa79-5754-9095-90ff1fc5b258 with identifier: AF54996
2025-12-05 10:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a97674af-aa79-5754-9095-90ff1fc5b258 with identifier: AF54996 to the API
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF54996>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:05:02Z',
 'fuel_type': 'hybrid',
 'id': 'a97674af-aa79-5754-9095-90ff1fc5b258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF54996',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 43421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2022}
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF54996%27 HTTP/1.1" 200 None
2025-12-05 10:03:05 [auto1.it] INFO: Saving data for AF54996: {'auction_closing_time': 1765037102.0, 'created_time': 1764619478.148404, 'last_price_update_time': 1764928985.122875}
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF54996') HTTP/1.1" 204 0
2025-12-05 10:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0aab090a-8b78-5c21-82dd-9c185fd99f9c with identifier: CA23439
2025-12-05 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0aab090a-8b78-5c21-82dd-9c185fd99f9c with identifier: CA23439
2025-12-05 10:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0aab090a-8b78-5c21-82dd-9c185fd99f9c with identifier: CA23439 to the API
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA23439>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:54:04Z',
 'fuel_type': 'petrol',
 'id': '0aab090a-8b78-5c21-82dd-9c185fd99f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA23439',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 29749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2023}
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA23439%27 HTTP/1.1" 200 None
2025-12-05 10:03:05 [auto1.it] INFO: Saving data for CA23439: {'auction_closing_time': 1765040044.0, 'created_time': 1764619479.291435, 'last_price_update_time': 1764928985.524166}
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA23439') HTTP/1.1" 204 0
2025-12-05 10:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with identifier: YZ75432
2025-12-05 10:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with identifier: YZ75432
2025-12-05 10:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10147ac9-ae36-5e8b-bfae-7b4bf146f01f with identifier: YZ75432 to the API
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YZ75432>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2025-12-06T16:02:34Z',
 'fuel_type': 'petrol',
 'id': '10147ac9-ae36-5e8b-bfae-7b4bf146f01f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ75432',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 60295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2017}
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YZ75432%27 HTTP/1.1" 200 None
2025-12-05 10:03:05 [auto1.it] INFO: Saving data for YZ75432: {'auction_closing_time': 1765036954.0, 'created_time': 1764187358.866383, 'last_price_update_time': 1764928985.992818}
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YZ75432') HTTP/1.1" 204 0
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_47f6b9639855be93e69159c9b032ef12.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU85214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_613aebdce2a49a2537c1925528573346.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2ee6c90>
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_47f6b9639855be93e69159c9b032ef12.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_47f6b9639855be93e69159c9b032ef12.jpg saved to cache
2025-12-05 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fade10>
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg saved to cache
2025-12-05 10:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e4aa10>
2025-12-05 10:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg saved to cache
2025-12-05 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30a57d0>
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg saved to cache
2025-12-05 10:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fad890>
2025-12-05 10:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_613aebdce2a49a2537c1925528573346.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_613aebdce2a49a2537c1925528573346.jpg saved to cache
2025-12-05 10:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KS83766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW22031> (referer: https://www.auto1.com/v1/car-details-view/GW22031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE49943> (referer: https://www.auto1.com/v1/car-details-view/RE49943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL72110> (referer: https://www.auto1.com/v1/car-details-view/GL72110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH16406/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG92403> (referer: https://www.auto1.com/v1/car-details-view/JG92403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d8d1924bfe487fbf930af14652e8eab0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_eb3cfea88392297106f07c80bf51c215.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:08 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: XA97837
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA97837%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for XA97837: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: PU99942
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU99942%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for PU99942: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: TF56529
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF56529%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for TF56529: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: KZ32796
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ32796%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for KZ32796: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: WV64596
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV64596%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for WV64596: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: BZ41530
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ41530%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for BZ41530: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: BT69215
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT69215%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for BT69215: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: WC40670
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC40670%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for WC40670: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: GG19645
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG19645%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for GG19645: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: BY74058
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY74058%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for BY74058: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: FR92122
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR92122%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for FR92122: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: WU37931
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU37931%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for WU37931: 0
2025-12-05 10:03:08 [auto1.it] INFO: Found listing with ID: DV19777
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV19777%27 HTTP/1.1" 200 None
2025-12-05 10:03:08 [auto1.it] INFO: Scrape type for DV19777: 2
2025-12-05 10:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf02f632-3c47-5aed-a60a-2f0489eb0b31 with identifier: GW22031
2025-12-05 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf02f632-3c47-5aed-a60a-2f0489eb0b31 with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf02f632-3c47-5aed-a60a-2f0489eb0b31 with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf02f632-3c47-5aed-a60a-2f0489eb0b31, identifier: GW22031
2025-12-05 10:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0658bda3-703a-5a46-9700-396c5edcdac3 with identifier: RE49943
2025-12-05 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0658bda3-703a-5a46-9700-396c5edcdac3 with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0658bda3-703a-5a46-9700-396c5edcdac3 with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0658bda3-703a-5a46-9700-396c5edcdac3, identifier: RE49943
2025-12-05 10:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6458d8-4fa5-562c-9b76-68144dc9e21a with identifier: GL72110
2025-12-05 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6458d8-4fa5-562c-9b76-68144dc9e21a with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6458d8-4fa5-562c-9b76-68144dc9e21a with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b6458d8-4fa5-562c-9b76-68144dc9e21a, identifier: GL72110
2025-12-05 10:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with identifier: JG92403
2025-12-05 10:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with scrape type 2
2025-12-05 10:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e, identifier: JG92403
2025-12-05 10:03:09 [auto1.it] INFO: Found listing with ID: FR95700
2025-12-05 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR95700%27 HTTP/1.1" 200 None
2025-12-05 10:03:09 [auto1.it] INFO: Scrape type for FR95700: 0
2025-12-05 10:03:09 [auto1.it] INFO: Found listing with ID: PM02095
2025-12-05 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM02095%27 HTTP/1.1" 200 None
2025-12-05 10:03:09 [auto1.it] INFO: Scrape type for PM02095: 2
2025-12-05 10:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf02f632-3c47-5aed-a60a-2f0489eb0b31 with identifier: GW22031
2025-12-05 10:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf02f632-3c47-5aed-a60a-2f0489eb0b31 with identifier: GW22031
2025-12-05 10:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf02f632-3c47-5aed-a60a-2f0489eb0b31 with identifier: GW22031 to the API
2025-12-05 10:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW22031>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:50:28Z',
 'fuel_type': 'petrol',
 'id': 'cf02f632-3c47-5aed-a60a-2f0489eb0b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW22031',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 52623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'manual',
 'trim': 'XLine 2WD',
 'year': 2021}
2025-12-05 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW22031%27 HTTP/1.1" 200 None
2025-12-05 10:03:11 [auto1.it] INFO: Saving data for GW22031: {'auction_closing_time': 1765039828.0, 'created_time': 1764187271.739538, 'last_price_update_time': 1764928991.994019}
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW22031') HTTP/1.1" 204 0
2025-12-05 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0658bda3-703a-5a46-9700-396c5edcdac3 with identifier: RE49943
2025-12-05 10:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0658bda3-703a-5a46-9700-396c5edcdac3 with identifier: RE49943
2025-12-05 10:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0658bda3-703a-5a46-9700-396c5edcdac3 with identifier: RE49943 to the API
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE49943>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:02:13Z',
 'fuel_type': 'petrol',
 'id': '0658bda3-703a-5a46-9700-396c5edcdac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE49943',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 88683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2018}
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE49943%27 HTTP/1.1" 200 None
2025-12-05 10:03:12 [auto1.it] INFO: Saving data for RE49943: {'auction_closing_time': 1765036933.0, 'created_time': 1764187453.057419, 'last_price_update_time': 1764928992.483953}
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RE49943') HTTP/1.1" 204 0
2025-12-05 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b6458d8-4fa5-562c-9b76-68144dc9e21a with identifier: GL72110
2025-12-05 10:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b6458d8-4fa5-562c-9b76-68144dc9e21a with identifier: GL72110
2025-12-05 10:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b6458d8-4fa5-562c-9b76-68144dc9e21a with identifier: GL72110 to the API
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL72110>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:03:24Z',
 'fuel_type': 'diesel',
 'id': '5b6458d8-4fa5-562c-9b76-68144dc9e21a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL72110',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 61905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTD Super',
 'transmission': 'automatic',
 'trim': 'Super',
 'year': 2019}
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL72110%27 HTTP/1.1" 200 None
2025-12-05 10:03:12 [auto1.it] INFO: Saving data for GL72110: {'auction_closing_time': 1765037004.0, 'created_time': 1764101121.0396, 'last_price_update_time': 1764928992.923126}
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GL72110') HTTP/1.1" 204 0
2025-12-05 10:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with identifier: JG92403
2025-12-05 10:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with identifier: JG92403
2025-12-05 10:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e with identifier: JG92403 to the API
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG92403>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:31:06Z',
 'fuel_type': 'petrol',
 'id': 'ebd708d5-b06b-5f0d-8a23-acdf6daa2a4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG92403',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 75101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Sport Edition 2',
 'transmission': 'manual',
 'trim': 'Sport Edition 2',
 'year': 2018}
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG92403%27 HTTP/1.1" 200 None
2025-12-05 10:03:13 [auto1.it] INFO: Saving data for JG92403: {'auction_closing_time': 1765038666.0, 'created_time': 1764101423.319742, 'last_price_update_time': 1764928993.371179}
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JG92403') HTTP/1.1" 204 0
2025-12-05 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_bf081c7f3d36912a25a5908d06a16cad.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ffd49ff3bd44554db3af2c685d560196.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:13 [auto1.it] INFO: Found listing with ID: TD37557
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD37557%27 HTTP/1.1" 200 None
2025-12-05 10:03:13 [auto1.it] INFO: Scrape type for TD37557: 0
2025-12-05 10:03:13 [auto1.it] INFO: Found listing with ID: GP34443
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP34443%27 HTTP/1.1" 200 None
2025-12-05 10:03:13 [auto1.it] INFO: Scrape type for GP34443: 0
2025-12-05 10:03:13 [auto1.it] INFO: Found listing with ID: NV88756
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV88756%27 HTTP/1.1" 200 None
2025-12-05 10:03:13 [auto1.it] INFO: Scrape type for NV88756: 0
2025-12-05 10:03:13 [auto1.it] INFO: Found listing with ID: MB14581
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB14581%27 HTTP/1.1" 200 None
2025-12-05 10:03:13 [auto1.it] INFO: Scrape type for MB14581: 2
2025-12-05 10:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH45068> (referer: https://www.auto1.com/v1/car-details-view/SH45068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fc54d0>
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F3b%252Fae3bab8e6dc36b66551ee57950fb9965%252Fpa%252FBG39549_d8d1924bfe487fbf930af14652e8eab0.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d8d1924bfe487fbf930af14652e8eab0.jpg saved to cache
2025-12-05 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 742e8ff7-eef2-59bd-8789-78ccbe896220
2025-12-05 10:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 742e8ff7-eef2-59bd-8789-78ccbe896220, skipping ID generation
2025-12-05 10:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742e8ff7-eef2-59bd-8789-78ccbe896220 with scrape type 1
2025-12-05 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 742e8ff7-eef2-59bd-8789-78ccbe896220 from tracking dictionaries
2025-12-05 10:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 742e8ff7-eef2-59bd-8789-78ccbe896220 sending to next pipeline
2025-12-05 10:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 742e8ff7-eef2-59bd-8789-78ccbe896220, identifier: BG39549
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef7690>
2025-12-05 10:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg saved to cache
2025-12-05 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f56350>
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_eb3cfea88392297106f07c80bf51c215.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_eb3cfea88392297106f07c80bf51c215.jpg saved to cache
2025-12-05 10:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 742e8ff7-eef2-59bd-8789-78ccbe896220 with identifier: BG39549
2025-12-05 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 742e8ff7-eef2-59bd-8789-78ccbe896220 with identifier: BG39549
2025-12-05 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176585 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176585
2025-12-05 10:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 742e8ff7-eef2-59bd-8789-78ccbe896220 spider: auto1.it
2025-12-05 10:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 742e8ff7-eef2-59bd-8789-78ccbe896220 due to rule: high_mileage_for_country.json, error: 176585 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176585
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:29:00Z',
 'fuel_type': 'diesel',
 'id': '742e8ff7-eef2-59bd-8789-78ccbe896220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG39549',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 176585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d8d1924bfe487fbf930af14652e8eab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9fccce89304bf67da1c641f1e432d68a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_fbdffff617c32fa80c73ce1ee5d97011.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_d666843562b708c37c5548a990773d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_ce4e50f2bd3f68faa7b4b51b040a00b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_a7af0a1e2b49acc2be4640d507adbcc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_1c7c0ad1573ec984527e55c6b64dd6ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_95523d860ba513c19476f7800cf29c2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9e6f443ac5f2eb8eedc5a6f045ee0f27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_bb266d77354597452d045b2b123e3bd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_15f8ab8d936c7e17aa49f1a165b61744.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_9ebea3a3a7717496c3bf7c45dbd2bed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_c51a61e618591fa15c2f19892d434bdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_958586b09706dfa62ed2ea58f8c1d248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742e8ff7-eef2-59bd-8789-78ccbe896220/742e8ff7-eef2-59bd-8789-78ccbe896220_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/3b/ae3bab8e6dc36b66551ee57950fb9965/pa/BG39549_584d1da47b442ef0f5cfd2ade99352f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG39549%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Saving data for BG39549: {'created_time': 1764928994.797877, 'last_price_update_time': 1764928994.79789, 'auction_closing_time': 1765038540.0}
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG39549') HTTP/1.1" 204 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: CU51739
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU51739%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for CU51739: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: YS25498
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS25498%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for YS25498: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: PT71577
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71577%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for PT71577: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: FP59077
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for FP59077: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: XL18907
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL18907%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for XL18907: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: CC90346
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC90346%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for CC90346: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: ZT50467
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT50467%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for ZT50467: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: PT58353
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT58353%27 HTTP/1.1" 200 None
2025-12-05 10:03:14 [auto1.it] INFO: Scrape type for PT58353: 0
2025-12-05 10:03:14 [auto1.it] INFO: Found listing with ID: LP81451
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP81451%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for LP81451: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: FX39220
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX39220%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for FX39220: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: HW64559
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for HW64559: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: RH31277
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH31277%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for RH31277: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: ED74770
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED74770%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for ED74770: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: BB39506
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB39506%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for BB39506: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: PY09316
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY09316%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for PY09316: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: UV47695
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for UV47695: 2
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: UV50835
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV50835%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for UV50835: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: JG05046
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG05046%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for JG05046: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: UA54373
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA54373%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for UA54373: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: CJ04754
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ04754%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for CJ04754: 0
2025-12-05 10:03:15 [auto1.it] INFO: Found listing with ID: ZE02649
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02649%27 HTTP/1.1" 200 None
2025-12-05 10:03:15 [auto1.it] INFO: Scrape type for ZE02649: 0
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f94d90>
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg saved to cache
2025-12-05 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f4d110>
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_bf081c7f3d36912a25a5908d06a16cad.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_bf081c7f3d36912a25a5908d06a16cad.jpg saved to cache
2025-12-05 10:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f1c510>
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg saved to cache
2025-12-05 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f55950>
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_ffd49ff3bd44554db3af2c685d560196.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ffd49ff3bd44554db3af2c685d560196.jpg saved to cache
2025-12-05 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470d6dd0-575b-5a4f-ab54-e1269bae8586 with identifier: SH45068
2025-12-05 10:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470d6dd0-575b-5a4f-ab54-e1269bae8586 with scrape type 2
2025-12-05 10:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470d6dd0-575b-5a4f-ab54-e1269bae8586 with scrape type 2
2025-12-05 10:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 470d6dd0-575b-5a4f-ab54-e1269bae8586, identifier: SH45068
2025-12-05 10:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 470d6dd0-575b-5a4f-ab54-e1269bae8586 with identifier: SH45068
2025-12-05 10:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 470d6dd0-575b-5a4f-ab54-e1269bae8586 with identifier: SH45068
2025-12-05 10:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172884 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172884
2025-12-05 10:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 470d6dd0-575b-5a4f-ab54-e1269bae8586 spider: auto1.it
2025-12-05 10:03:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 470d6dd0-575b-5a4f-ab54-e1269bae8586 due to rule: high_mileage_for_country.json, error: 172884 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172884
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:54:47Z',
 'fuel_type': 'diesel',
 'id': '470d6dd0-575b-5a4f-ab54-e1269bae8586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH45068',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 172884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2018}
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH45068%27 HTTP/1.1" 200 None
2025-12-05 10:03:16 [auto1.it] INFO: Saving data for SH45068: {'auction_closing_time': 1765040087.0, 'created_time': 1764187378.026888, 'last_price_update_time': 1764928996.799061}
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH45068') HTTP/1.1" 204 0
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_46d6b036d35996d409c1d07e0ae69884.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR20498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU85214> (referer: https://www.auto1.com/v1/car-details-view/JU85214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD13712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP36603> (referer: https://www.auto1.com/v1/car-details-view/CP36603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA12776> (referer: https://www.auto1.com/v1/car-details-view/CA12776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ01897> (referer: https://www.auto1.com/v1/car-details-view/ZJ01897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_45cb6393f278aee1cd2501af6275f611.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_a8417e981e0d867c5f51247e8736ae23.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_a6314e6be5932cd371970360ba6f6f6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db1ec7e10>
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_46d6b036d35996d409c1d07e0ae69884.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_46d6b036d35996d409c1d07e0ae69884.jpg saved to cache
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_f3a701235e44ee189055c4e392818b86.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_5b06e42b281d4727284cc96f045fa403.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c54912e-617d-50d0-8574-5899c348e37e with identifier: JU85214
2025-12-05 10:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c54912e-617d-50d0-8574-5899c348e37e with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c54912e-617d-50d0-8574-5899c348e37e with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c54912e-617d-50d0-8574-5899c348e37e, identifier: JU85214
2025-12-05 10:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2298de-fbe7-5b95-a687-a4a634af02a8 with identifier: CP36603
2025-12-05 10:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2298de-fbe7-5b95-a687-a4a634af02a8 with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f2298de-fbe7-5b95-a687-a4a634af02a8 with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f2298de-fbe7-5b95-a687-a4a634af02a8, identifier: CP36603
2025-12-05 10:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d61981a0-6f8d-5305-b8b8-de82410c33e5 with identifier: CA12776
2025-12-05 10:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61981a0-6f8d-5305-b8b8-de82410c33e5 with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d61981a0-6f8d-5305-b8b8-de82410c33e5 with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d61981a0-6f8d-5305-b8b8-de82410c33e5, identifier: CA12776
2025-12-05 10:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with identifier: ZJ01897
2025-12-05 10:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with scrape type 2
2025-12-05 10:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e, identifier: ZJ01897
2025-12-05 10:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34477d0>
2025-12-05 10:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_45cb6393f278aee1cd2501af6275f611.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_45cb6393f278aee1cd2501af6275f611.jpg saved to cache
2025-12-05 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0114850>
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_a8417e981e0d867c5f51247e8736ae23.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_a8417e981e0d867c5f51247e8736ae23.jpg saved to cache
2025-12-05 10:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fbb210>
2025-12-05 10:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F7b%252F837bb87d43ef774aea92dafa6b8cacb5%252Fpa%252FGF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg saved to cache
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e133b7dd-1481-5fdd-9873-e854a0a676c9
2025-12-05 10:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e133b7dd-1481-5fdd-9873-e854a0a676c9, skipping ID generation
2025-12-05 10:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e133b7dd-1481-5fdd-9873-e854a0a676c9 with scrape type 1
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e133b7dd-1481-5fdd-9873-e854a0a676c9 from tracking dictionaries
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e133b7dd-1481-5fdd-9873-e854a0a676c9 sending to next pipeline
2025-12-05 10:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e133b7dd-1481-5fdd-9873-e854a0a676c9, identifier: GF05502
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eec9d0>
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_a6314e6be5932cd371970360ba6f6f6c.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_a6314e6be5932cd371970360ba6f6f6c.jpg saved to cache
2025-12-05 10:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c54912e-617d-50d0-8574-5899c348e37e with identifier: JU85214
2025-12-05 10:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c54912e-617d-50d0-8574-5899c348e37e with identifier: JU85214
2025-12-05 10:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c54912e-617d-50d0-8574-5899c348e37e with identifier: JU85214 to the API
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU85214>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:58:22Z',
 'fuel_type': 'petrol',
 'id': '9c54912e-617d-50d0-8574-5899c348e37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU85214',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU85214%27 HTTP/1.1" 200 None
2025-12-05 10:03:20 [auto1.it] INFO: Saving data for JU85214: {'auction_closing_time': 1765040302.0, 'created_time': 1764187244.609116, 'last_price_update_time': 1764929000.068193}
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU85214') HTTP/1.1" 204 0
2025-12-05 10:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f2298de-fbe7-5b95-a687-a4a634af02a8 with identifier: CP36603
2025-12-05 10:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f2298de-fbe7-5b95-a687-a4a634af02a8 with identifier: CP36603
2025-12-05 10:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f2298de-fbe7-5b95-a687-a4a634af02a8 with identifier: CP36603 to the API
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP36603>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:51:40Z',
 'fuel_type': 'diesel',
 'id': '4f2298de-fbe7-5b95-a687-a4a634af02a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP36603',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 72001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP36603%27 HTTP/1.1" 200 None
2025-12-05 10:03:20 [auto1.it] INFO: Saving data for CP36603: {'auction_closing_time': 1765039900.0, 'created_time': 1763755243.921083, 'last_price_update_time': 1764929000.432439}
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP36603') HTTP/1.1" 204 0
2025-12-05 10:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d61981a0-6f8d-5305-b8b8-de82410c33e5 with identifier: CA12776
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2025-12-05 10:03:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d61981a0-6f8d-5305-b8b8-de82410c33e5 with identifier: CA12776
2025-12-05 10:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d61981a0-6f8d-5305-b8b8-de82410c33e5 with identifier: CA12776 to the API
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA12776>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2025-12-06T16:36:27Z',
 'fuel_type': 'diesel',
 'id': 'd61981a0-6f8d-5305-b8b8-de82410c33e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA12776',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 117812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA12776%27 HTTP/1.1" 200 None
2025-12-05 10:03:21 [auto1.it] INFO: Saving data for CA12776: {'auction_closing_time': 1765038987.0, 'created_time': 1764100874.616248, 'last_price_update_time': 1764929001.025525}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA12776') HTTP/1.1" 204 0
2025-12-05 10:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with identifier: ZJ01897
2025-12-05 10:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with identifier: ZJ01897
2025-12-05 10:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e with identifier: ZJ01897 to the API
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ01897>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-06T16:04:23Z',
 'fuel_type': 'diesel',
 'id': 'bae1ed35-1ba8-5b6c-8bd2-8f0c606c6f2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ01897',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 117977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2017}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ01897%27 HTTP/1.1" 200 None
2025-12-05 10:03:21 [auto1.it] INFO: Saving data for ZJ01897: {'auction_closing_time': 1765037063.0, 'created_time': 1764187239.460128, 'last_price_update_time': 1764929001.490899}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ01897') HTTP/1.1" 204 0
2025-12-05 10:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e133b7dd-1481-5fdd-9873-e854a0a676c9 with identifier: GF05502
2025-12-05 10:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e133b7dd-1481-5fdd-9873-e854a0a676c9 with identifier: GF05502
2025-12-05 10:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e133b7dd-1481-5fdd-9873-e854a0a676c9 with identifier: GF05502 to the API
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2025-12-06T16:37:44Z',
 'fuel_type': 'gas',
 'id': 'e133b7dd-1481-5fdd-9873-e854a0a676c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF05502',
 'listing': 'auction',
 'location': 'IT, Marino',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 73128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2950592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_dc6152693d50ff18e169699c0a6e7cc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_a8417e981e0d867c5f51247e8736ae23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_28a8d91854cbba8387267f055459f0e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868296,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_613aebdce2a49a2537c1925528573346.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2972603,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_ebd130e32abed670c10a3f1e0524f6b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_c27c778e541fa79b3ce5b79bcf67f436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817072,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4b720f3c08b6522f4ec0540ea553b0d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316202,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_52cc0fa5b6035bffc1d6a99364224e81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_07922f22f303172e33e39c63b59e7254.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_f30032b63c01a63f798d4c6b28f74bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2464469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_2c398beb3364ab0b9eb311ccbc96d3e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_e760504218a6107fe799ceb76c708a65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_5353328fd0eeb1fe95a01ac4eb666066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_4f3050dd7989d8963a99b62b45a606fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e133b7dd-1481-5fdd-9873-e854a0a676c9/e133b7dd-1481-5fdd-9873-e854a0a676c9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/7b/837bb87d43ef774aea92dafa6b8cacb5/pa/GF05502_16b33338ae3e028598e2c05896fb5d3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05502%27 HTTP/1.1" 200 None
2025-12-05 10:03:21 [auto1.it] INFO: Saving data for GF05502: {'created_time': 1764929001.974141, 'last_price_update_time': 1764929001.974153, 'auction_closing_time': 1765039064.0}
2025-12-05 10:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GF05502') HTTP/1.1" 204 0
2025-12-05 10:03:22 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 47 pages/min), scraped 51 items (at 27 items/min)
2025-12-05 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM02095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB82750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d5b810>
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_f3a701235e44ee189055c4e392818b86.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_f3a701235e44ee189055c4e392818b86.jpg saved to cache
2025-12-05 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e90090>
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_5b06e42b281d4727284cc96f045fa403.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_5b06e42b281d4727284cc96f045fa403.jpg saved to cache
2025-12-05 10:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV19777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB14581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KS83766> (referer: https://www.auto1.com/v1/car-details-view/KS83766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH16406> (referer: https://www.auto1.com/v1/car-details-view/LH16406/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV47695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_13a97e8229e31f070595796bb9893125.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:23 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: PH80137
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH80137%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for PH80137: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: ET83894
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET83894%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for ET83894: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: KS14741
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS14741%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for KS14741: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: TC26238
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC26238%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for TC26238: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: YJ30752
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ30752%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for YJ30752: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: YJ69591
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ69591%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for YJ69591: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: ZE06334
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE06334%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for ZE06334: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: AT29817
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT29817%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for AT29817: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: KF46878
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF46878%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for KF46878: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: KJ80405
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ80405%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for KJ80405: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: YP01522
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP01522%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for YP01522: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: DJ97439
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ97439%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for DJ97439: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: UA95207
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA95207%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for UA95207: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: EX29579
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX29579%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for EX29579: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: NF03892
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for NF03892: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: SP78957
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP78957%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for SP78957: 0
2025-12-05 10:03:23 [auto1.it] INFO: Found listing with ID: DS34297
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS34297%27 HTTP/1.1" 200 None
2025-12-05 10:03:23 [auto1.it] INFO: Scrape type for DS34297: 2
2025-12-05 10:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with identifier: KS83766
2025-12-05 10:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with scrape type 2
2025-12-05 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with scrape type 2
2025-12-05 10:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f773e4e-91a1-5c8b-b995-d488ddeb0380, identifier: KS83766
2025-12-05 10:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7985e73-9275-5cd5-98f7-2bbfa380f673 with identifier: LH16406
2025-12-05 10:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7985e73-9275-5cd5-98f7-2bbfa380f673 with scrape type 2
2025-12-05 10:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7985e73-9275-5cd5-98f7-2bbfa380f673 with scrape type 2
2025-12-05 10:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7985e73-9275-5cd5-98f7-2bbfa380f673, identifier: LH16406
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: TM51143
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM51143%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for TM51143: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: KE62864
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE62864%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for KE62864: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: WZ33226
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ33226%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for WZ33226: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: UW43459
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW43459%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for UW43459: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: CZ68457
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68457%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for CZ68457: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: WR77896
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR77896%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for WR77896: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: KB67201
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB67201%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for KB67201: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: CK36923
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for CK36923: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: TW27290
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW27290%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for TW27290: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: PD39059
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD39059%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for PD39059: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: BF19781
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF19781%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for BF19781: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: SJ43277
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ43277%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for SJ43277: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: NC97900
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC97900%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for NC97900: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: NC36424
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC36424%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for NC36424: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: TX11998
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX11998%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for TX11998: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: TZ24707
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for TZ24707: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: EU62020
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU62020%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for EU62020: 0
2025-12-05 10:03:24 [auto1.it] INFO: Found listing with ID: ML50616
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML50616%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Scrape type for ML50616: 2
2025-12-05 10:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with identifier: KS83766
2025-12-05 10:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with identifier: KS83766
2025-12-05 10:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f773e4e-91a1-5c8b-b995-d488ddeb0380 with identifier: KS83766 to the API
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KS83766>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:40:06Z',
 'fuel_type': 'petrol',
 'id': '4f773e4e-91a1-5c8b-b995-d488ddeb0380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS83766',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 89606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS83766%27 HTTP/1.1" 200 None
2025-12-05 10:03:24 [auto1.it] INFO: Saving data for KS83766: {'auction_closing_time': 1764952806.0, 'created_time': 1764619271.84946, 'last_price_update_time': 1764929004.97679}
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS83766') HTTP/1.1" 204 0
2025-12-05 10:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7985e73-9275-5cd5-98f7-2bbfa380f673 with identifier: LH16406
2025-12-05 10:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7985e73-9275-5cd5-98f7-2bbfa380f673 with identifier: LH16406
2025-12-05 10:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158581 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158581
2025-12-05 10:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f7985e73-9275-5cd5-98f7-2bbfa380f673 spider: auto1.it
2025-12-05 10:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f7985e73-9275-5cd5-98f7-2bbfa380f673 due to rule: high_mileage_for_country.json, error: 158581 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158581
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2025-12-06T16:24:54Z',
 'fuel_type': 'petrol',
 'id': 'f7985e73-9275-5cd5-98f7-2bbfa380f673',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH16406',
 'listing': 'auction',
 'location': 'IT, DECIMOMANNU (CA)',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 158581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH16406%27 HTTP/1.1" 200 None
2025-12-05 10:03:25 [auto1.it] INFO: Saving data for LH16406: {'auction_closing_time': 1765038294.0, 'created_time': 1763668849.948428, 'last_price_update_time': 1764929005.346488}
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH16406') HTTP/1.1" 204 0
2025-12-05 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_573acc3162d168fa27e71cedbd4ffaed.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fbb650>
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_13a97e8229e31f070595796bb9893125.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_13a97e8229e31f070595796bb9893125.jpg saved to cache
2025-12-05 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fb9910>
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg saved to cache
2025-12-05 10:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:25 [auto1.it] INFO: Found listing with ID: FP51001
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP51001%27 HTTP/1.1" 200 None
2025-12-05 10:03:25 [auto1.it] INFO: Scrape type for FP51001: 0
2025-12-05 10:03:25 [auto1.it] INFO: Found listing with ID: KR99433
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR99433%27 HTTP/1.1" 200 None
2025-12-05 10:03:25 [auto1.it] INFO: Scrape type for KR99433: 0
2025-12-05 10:03:25 [auto1.it] INFO: Found listing with ID: EL02026
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL02026%27 HTTP/1.1" 200 None
2025-12-05 10:03:25 [auto1.it] INFO: Scrape type for EL02026: 0
2025-12-05 10:03:25 [auto1.it] INFO: Found listing with ID: KT18742
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT18742%27 HTTP/1.1" 200 None
2025-12-05 10:03:26 [auto1.it] INFO: Scrape type for KT18742: 2
2025-12-05 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD13712> (referer: https://www.auto1.com/v1/car-details-view/MD13712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS14568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:26 [auto1.it] INFO: Found listing with ID: DF71090
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF71090%27 HTTP/1.1" 200 None
2025-12-05 10:03:26 [auto1.it] INFO: Scrape type for DF71090: 0
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f80650>
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_573acc3162d168fa27e71cedbd4ffaed.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_573acc3162d168fa27e71cedbd4ffaed.jpg saved to cache
2025-12-05 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fae550>
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg saved to cache
2025-12-05 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD64809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM83226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with identifier: MD13712
2025-12-05 10:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with scrape type 2
2025-12-05 10:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with scrape type 2
2025-12-05 10:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5db4727b-19f8-5ad6-8748-fc79a5f4bd08, identifier: MD13712
2025-12-05 10:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with identifier: MD13712
2025-12-05 10:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with identifier: MD13712
2025-12-05 10:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5db4727b-19f8-5ad6-8748-fc79a5f4bd08 with identifier: MD13712 to the API
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD13712>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:23:17Z',
 'fuel_type': 'diesel',
 'id': '5db4727b-19f8-5ad6-8748-fc79a5f4bd08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD13712',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 72001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD13712%27 HTTP/1.1" 200 None
2025-12-05 10:03:27 [auto1.it] INFO: Saving data for MD13712: {'auction_closing_time': 1765038197.0, 'created_time': 1764151468.557627, 'last_price_update_time': 1764929007.338547}
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD13712') HTTP/1.1" 204 0
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6b6a9749ddb55915f8a9de861f19c406.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_7153d65306fbb95a8df8e40762f0d8de.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR20498> (referer: https://www.auto1.com/v1/car-details-view/PR20498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB82750> (referer: https://www.auto1.com/v1/car-details-view/AB82750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM02095> (referer: https://www.auto1.com/v1/car-details-view/PM02095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_7d823f43950f52e8099d889bc3fcf085.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_58a818150817b40b15b33eb50dd7766b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d29072a81febb5e804654ad051b515a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33ef710>
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_6b6a9749ddb55915f8a9de861f19c406.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6b6a9749ddb55915f8a9de861f19c406.jpg saved to cache
2025-12-05 10:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f13d10>
2025-12-05 10:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_7153d65306fbb95a8df8e40762f0d8de.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_7153d65306fbb95a8df8e40762f0d8de.jpg saved to cache
2025-12-05 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV47695> (referer: https://www.auto1.com/v1/car-details-view/UV47695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB14581> (referer: https://www.auto1.com/v1/car-details-view/MB14581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with identifier: PR20498
2025-12-05 10:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98c53741-c0d4-50b1-8ecf-28fd77d00b0f, identifier: PR20498
2025-12-05 10:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with identifier: AB82750
2025-12-05 10:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3, identifier: AB82750
2025-12-05 10:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with identifier: PM02095
2025-12-05 10:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with scrape type 2
2025-12-05 10:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365, identifier: PM02095
2025-12-05 10:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bd590>
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_7d823f43950f52e8099d889bc3fcf085.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_7d823f43950f52e8099d889bc3fcf085.jpg saved to cache
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33371d0>
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_58a818150817b40b15b33eb50dd7766b.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_58a818150817b40b15b33eb50dd7766b.jpg saved to cache
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eac810>
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg saved to cache
2025-12-05 10:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3dba7d0>
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_d29072a81febb5e804654ad051b515a7.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d29072a81febb5e804654ad051b515a7.jpg saved to cache
2025-12-05 10:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:30 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with identifier: PR20498
2025-12-05 10:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with identifier: PR20498
2025-12-05 10:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98c53741-c0d4-50b1-8ecf-28fd77d00b0f with identifier: PR20498 to the API
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR20498>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 299,
 'expiration_date': '2025-12-06T16:49:22Z',
 'fuel_type': 'hybrid',
 'id': '98c53741-c0d4-50b1-8ecf-28fd77d00b0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR20498',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 58583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR20498%27 HTTP/1.1" 200 None
2025-12-05 10:03:30 [auto1.it] INFO: Saving data for PR20498: {'auction_closing_time': 1765039762.0, 'created_time': 1763064293.138616, 'last_price_update_time': 1764929010.48047}
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR20498') HTTP/1.1" 204 0
2025-12-05 10:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with identifier: AB82750
2025-12-05 10:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with identifier: AB82750
2025-12-05 10:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a0839e4-50b6-581e-98e9-b14fe6c9b6a3 with identifier: AB82750 to the API
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB82750>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:48:35Z',
 'fuel_type': 'diesel',
 'id': '6a0839e4-50b6-581e-98e9-b14fe6c9b6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB82750',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 145302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB82750%27 HTTP/1.1" 200 None
2025-12-05 10:03:30 [auto1.it] INFO: Saving data for AB82750: {'auction_closing_time': 1765039715.0, 'created_time': 1762977852.995597, 'last_price_update_time': 1764929010.90916}
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB82750') HTTP/1.1" 204 0
2025-12-05 10:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with identifier: PM02095
2025-12-05 10:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with identifier: PM02095
2025-12-05 10:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365 with identifier: PM02095 to the API
2025-12-05 10:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM02095>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-05T16:43:52Z',
 'fuel_type': 'petrol',
 'id': '2132c5e1-ed0e-55aa-a1cb-66a0fa9e9365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM02095',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 118497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2018}
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM02095%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Saving data for PM02095: {'auction_closing_time': 1764953032.0, 'created_time': 1764748855.703894, 'last_price_update_time': 1764929012.431968}
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM02095') HTTP/1.1" 204 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: GD75064
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for GD75064: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: GR38482
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR38482%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for GR38482: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: WB53951
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB53951%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for WB53951: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: UH13472
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH13472%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for UH13472: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: EP12746
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP12746%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for EP12746: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: RS56779
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56779%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for RS56779: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: GE92322
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE92322%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for GE92322: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: HT90813
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT90813%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for HT90813: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: PU08836
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU08836%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for PU08836: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: RZ76447
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ76447%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for RZ76447: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: GE71060
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE71060%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for GE71060: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: CM56343
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM56343%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for CM56343: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: VV30676
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for VV30676: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: XK46480
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK46480%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for XK46480: 2
2025-12-05 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS34297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML50616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: DH42983
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH42983%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for DH42983: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: CC80273
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC80273%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for CC80273: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: FA93645
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93645%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for FA93645: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: RT08597
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT08597%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for RT08597: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: LL77608
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL77608%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for LL77608: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: XM03029
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for XM03029: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: JL07662
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL07662%27 HTTP/1.1" 200 None
2025-12-05 10:03:32 [auto1.it] INFO: Scrape type for JL07662: 0
2025-12-05 10:03:32 [auto1.it] INFO: Found listing with ID: XE21844
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE21844%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for XE21844: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: UA91448
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA91448%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for UA91448: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: NC05210
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC05210%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for NC05210: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: NG74422
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74422%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for NG74422: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: NF87489
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87489%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for NF87489: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: FC65085
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC65085%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for FC65085: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: WU55594
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU55594%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for WU55594: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: KG59903
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG59903%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for KG59903: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: BX82735
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX82735%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for BX82735: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: XZ44550
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ44550%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for XZ44550: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: FR46544
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR46544%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for FR46544: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: MR91682
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR91682%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for MR91682: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: BS05817
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS05817%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for BS05817: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: JX07186
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX07186%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for JX07186: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: CF29470
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF29470%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for CF29470: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: WP88686
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88686%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for WP88686: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: NZ68361
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ68361%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for NZ68361: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: KV00953
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV00953%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for KV00953: 0
2025-12-05 10:03:33 [auto1.it] INFO: Found listing with ID: AY82882
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY82882%27 HTTP/1.1" 200 None
2025-12-05 10:03:33 [auto1.it] INFO: Scrape type for AY82882: 0
2025-12-05 10:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2025-12-05 10:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3342bba9-2d13-5623-9104-beb227bf1fe4 with scrape type 2
2025-12-05 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3342bba9-2d13-5623-9104-beb227bf1fe4 with scrape type 2
2025-12-05 10:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3342bba9-2d13-5623-9104-beb227bf1fe4, identifier: UV47695
2025-12-05 10:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with identifier: MB14581
2025-12-05 10:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with scrape type 2
2025-12-05 10:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with scrape type 2
2025-12-05 10:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9fec9aa0-cc4d-5e61-b581-3b4ec29507af, identifier: MB14581
2025-12-05 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_ac2e56b37985e77f86e2f2786167fff1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_febc54288a87d7c166d9d88671e4d0d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2025-12-05 10:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695
2025-12-05 10:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3342bba9-2d13-5623-9104-beb227bf1fe4 with identifier: UV47695 to the API
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UV47695>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 162,
 'expiration_date': '2025-12-05T16:15:22Z',
 'fuel_type': 'petrol',
 'id': '3342bba9-2d13-5623-9104-beb227bf1fe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV47695',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'MG',
 'model': 'HS',
 'odometer': 57051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG HS 1.5 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2025-12-05 10:03:34 [auto1.it] INFO: Saving data for UV47695: {'auction_closing_time': 1764951322.0, 'created_time': 1764748859.349005, 'last_price_update_time': 1764929014.06341}
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UV47695') HTTP/1.1" 204 0
2025-12-05 10:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with identifier: MB14581
2025-12-05 10:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with identifier: MB14581
2025-12-05 10:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9fec9aa0-cc4d-5e61-b581-3b4ec29507af with identifier: MB14581 to the API
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB14581>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 86,
 'expiration_date': '2025-12-05T16:17:18Z',
 'fuel_type': 'petrol',
 'id': '9fec9aa0-cc4d-5e61-b581-3b4ec29507af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB14581',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 60982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2019}
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB14581%27 HTTP/1.1" 200 None
2025-12-05 10:03:34 [auto1.it] INFO: Saving data for MB14581: {'auction_closing_time': 1764951438.0, 'created_time': 1764748864.217447, 'last_price_update_time': 1764929014.540646}
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB14581') HTTP/1.1" 204 0
2025-12-05 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2a01f0958c468d2ac04893ec9d19b970.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6a6d372ccaf671a91784159ef1613034.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_0d02cc821f84dde61d78e4460c5998b8.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT18742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eec6d0>
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_ac2e56b37985e77f86e2f2786167fff1.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_ac2e56b37985e77f86e2f2786167fff1.jpg saved to cache
2025-12-05 10:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f971d0>
2025-12-05 10:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_febc54288a87d7c166d9d88671e4d0d1.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_febc54288a87d7c166d9d88671e4d0d1.jpg saved to cache
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_44ac21cc4e3de0cf1363675094a3e065.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0cc302dc06773eeb43f8011d30bd4109.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bd690>
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Ff3%252F6cf347da354763c55ce92f51d7248457%252Fpa%252FXU79981_2a01f0958c468d2ac04893ec9d19b970.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2a01f0958c468d2ac04893ec9d19b970.jpg saved to cache
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b
2025-12-05 10:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84133d08-5cdb-5bb8-ab25-c8e24482d91b, skipping ID generation
2025-12-05 10:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b with scrape type 1
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84133d08-5cdb-5bb8-ab25-c8e24482d91b from tracking dictionaries
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84133d08-5cdb-5bb8-ab25-c8e24482d91b sending to next pipeline
2025-12-05 10:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84133d08-5cdb-5bb8-ab25-c8e24482d91b, identifier: XU79981
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f95cd0>
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_6a6d372ccaf671a91784159ef1613034.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6a6d372ccaf671a91784159ef1613034.jpg saved to cache
2025-12-05 10:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f140d0>
2025-12-05 10:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_0d02cc821f84dde61d78e4460c5998b8.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_0d02cc821f84dde61d78e4460c5998b8.jpg saved to cache
2025-12-05 10:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84133d08-5cdb-5bb8-ab25-c8e24482d91b with identifier: XU79981
2025-12-05 10:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84133d08-5cdb-5bb8-ab25-c8e24482d91b with identifier: XU79981
2025-12-05 10:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 84133d08-5cdb-5bb8-ab25-c8e24482d91b with identifier: XU79981 to the API
2025-12-05 10:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2a01f0958c468d2ac04893ec9d19b970.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:50:36Z',
 'fuel_type': 'diesel',
 'id': '84133d08-5cdb-5bb8-ab25-c8e24482d91b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU79981',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 79783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2a01f0958c468d2ac04893ec9d19b970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_20c39dd0303eeb93a2cc3b2ad2502eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_6ed8b16264cf00a5eb992d4d97a14aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_573acc3162d168fa27e71cedbd4ffaed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_5b06e42b281d4727284cc96f045fa403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ffd49ff3bd44554db3af2c685d560196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_583ce650c461fe4cbeb9fa97a4acb1c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_2fe84c4a8d34ae2ea14849188a0f7ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_f92ba26c73f1126dd1e7eb21c8834c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_d4d4760d4b2da2523944dbd8579488ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_dffa1c6f7ec7d7ff7912d29c0b3ebac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_cd21a720f4e3fb9122735b4c5c235823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_e16042649c00ef9c980b0ac4dc0e697f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_c9d7c7ebd240b87cbaa29aa6f62f1683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84133d08-5cdb-5bb8-ab25-c8e24482d91b/84133d08-5cdb-5bb8-ab25-c8e24482d91b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/f3/6cf347da354763c55ce92f51d7248457/pa/XU79981_ce4666e1f8883128bf1b7e25679af8c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU79981%27 HTTP/1.1" 200 None
2025-12-05 10:03:37 [auto1.it] INFO: Saving data for XU79981: {'created_time': 1764929017.38551, 'last_price_update_time': 1764929017.385524, 'auction_closing_time': 1765039836.0}
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU79981') HTTP/1.1" 204 0
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM83226> (referer: https://www.auto1.com/v1/car-details-view/BM83226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD64809> (referer: https://www.auto1.com/v1/car-details-view/ZD64809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR27447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK46480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS14568> (referer: https://www.auto1.com/v1/car-details-view/NS14568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_57ff15223d4884e1045e665fc420da5b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_88451015b9df53fd32ea727f85bbca6c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34c1390>
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_44ac21cc4e3de0cf1363675094a3e065.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_44ac21cc4e3de0cf1363675094a3e065.jpg saved to cache
2025-12-05 10:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34754d0>
2025-12-05 10:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_0cc302dc06773eeb43f8011d30bd4109.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0cc302dc06773eeb43f8011d30bd4109.jpg saved to cache
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30abc90>
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg saved to cache
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3fd2d90>
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg saved to cache
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM40401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV19777> (referer: https://www.auto1.com/v1/car-details-view/DV19777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:38 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2025-12-05 10:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with scrape type 2
2025-12-05 10:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with scrape type 2
2025-12-05 10:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd, identifier: BM83226
2025-12-05 10:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3836baa7-c602-5700-ae0d-8723c96bffaa with identifier: ZD64809
2025-12-05 10:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3836baa7-c602-5700-ae0d-8723c96bffaa with scrape type 2
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3836baa7-c602-5700-ae0d-8723c96bffaa with scrape type 2
2025-12-05 10:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3836baa7-c602-5700-ae0d-8723c96bffaa, identifier: ZD64809
2025-12-05 10:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2025-12-05 10:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29707ce-c7f5-5813-a79a-b969c24a53c8 with scrape type 2
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29707ce-c7f5-5813-a79a-b969c24a53c8 with scrape type 2
2025-12-05 10:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a29707ce-c7f5-5813-a79a-b969c24a53c8, identifier: NS14568
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0085c90>
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_57ff15223d4884e1045e665fc420da5b.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_57ff15223d4884e1045e665fc420da5b.jpg saved to cache
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f579d0>
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_88451015b9df53fd32ea727f85bbca6c.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_88451015b9df53fd32ea727f85bbca6c.jpg saved to cache
2025-12-05 10:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2025-12-05 10:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2025-12-05 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190839 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190839
2025-12-05 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd spider: auto1.it
2025-12-05 10:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd due to rule: high_mileage_for_country.json, error: 190839 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190839
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-06T16:47:08Z',
 'fuel_type': 'diesel',
 'id': 'ee27dbea-1fbb-5f5e-add5-6fea10abbdbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM83226',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 190839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 35 TDI Mild-Hybrid design',
 'transmission': 'automatic',
 'trim': 'design',
 'year': 2020}
2025-12-05 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2025-12-05 10:03:40 [auto1.it] INFO: Saving data for BM83226: {'auction_closing_time': 1765039628.0, 'created_time': 1764151444.409924, 'last_price_update_time': 1764929020.213422}
2025-12-05 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM83226') HTTP/1.1" 204 0
2025-12-05 10:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3836baa7-c602-5700-ae0d-8723c96bffaa with identifier: ZD64809
2025-12-05 10:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3836baa7-c602-5700-ae0d-8723c96bffaa with identifier: ZD64809
2025-12-05 10:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3836baa7-c602-5700-ae0d-8723c96bffaa with identifier: ZD64809 to the API
2025-12-05 10:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD64809>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-06T16:50:52Z',
 'fuel_type': 'gas',
 'id': '3836baa7-c602-5700-ae0d-8723c96bffaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD64809',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 79085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 LPG Elefantino Blu',
 'transmission': 'manual',
 'trim': 'Elefantino Blu',
 'year': 2019}
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD64809%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Saving data for ZD64809: {'auction_closing_time': 1765039852.0, 'created_time': 1763669242.902225, 'last_price_update_time': 1764929021.221841}
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD64809') HTTP/1.1" 204 0
2025-12-05 10:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2025-12-05 10:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2025-12-05 10:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568 to the API
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS14568>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-06T16:19:47Z',
 'fuel_type': 'petrol',
 'id': 'a29707ce-c7f5-5813-a79a-b969c24a53c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14568',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 44558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Saving data for NS14568: {'auction_closing_time': 1765037987.0, 'created_time': 1764101162.111515, 'last_price_update_time': 1764929021.633514}
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS14568') HTTP/1.1" 204 0
2025-12-05 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: SC02424
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC02424%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for SC02424: 0
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: HR12611
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR12611%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for HR12611: 0
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: MG03562
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG03562%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for MG03562: 0
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: FN18507
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN18507%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for FN18507: 0
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: PU69330
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU69330%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for PU69330: 2
2025-12-05 10:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d0944d1169623a112944a4fe028dbe81.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: FV46735
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV46735%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for FV46735: 0
2025-12-05 10:03:41 [auto1.it] INFO: Found listing with ID: BK91681
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK91681%27 HTTP/1.1" 200 None
2025-12-05 10:03:41 [auto1.it] INFO: Scrape type for BK91681: 2
2025-12-05 10:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66f784ce-b7ce-59be-b440-ff1a9880451f with identifier: DV19777
2025-12-05 10:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66f784ce-b7ce-59be-b440-ff1a9880451f with scrape type 2
2025-12-05 10:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66f784ce-b7ce-59be-b440-ff1a9880451f with scrape type 2
2025-12-05 10:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66f784ce-b7ce-59be-b440-ff1a9880451f, identifier: DV19777
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2ee5a90>
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg saved to cache
2025-12-05 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da332de50>
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg saved to cache
2025-12-05 10:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2edc3d0>
2025-12-05 10:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg saved to cache
2025-12-05 10:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: NX67246
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX67246%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for NX67246: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: KC39062
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC39062%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for KC39062: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: VM28739
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM28739%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for VM28739: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: RV96232
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV96232%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for RV96232: 2
2025-12-05 10:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66f784ce-b7ce-59be-b440-ff1a9880451f with identifier: DV19777
2025-12-05 10:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66f784ce-b7ce-59be-b440-ff1a9880451f with identifier: DV19777
2025-12-05 10:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66f784ce-b7ce-59be-b440-ff1a9880451f with identifier: DV19777 to the API
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV19777>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.5L',
 'engine_horse_power': 400,
 'expiration_date': '2025-12-05T16:55:38Z',
 'fuel_type': 'petrol',
 'id': '66f784ce-b7ce-59be-b440-ff1a9880451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV19777',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 83742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV19777%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Saving data for DV19777: {'auction_closing_time': 1764953738.0, 'created_time': 1764748872.370562, 'last_price_update_time': 1764929023.510037}
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV19777') HTTP/1.1" 204 0
2025-12-05 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_a29c048c40d15aa597edb54cb5d94ced.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: ZK51756
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK51756%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for ZK51756: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: AW43246
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW43246%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for AW43246: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: DY55087
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY55087%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for DY55087: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: SP33249
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP33249%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for SP33249: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: UC23056
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC23056%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for UC23056: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: YR95481
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for YR95481: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: SP51039
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP51039%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for SP51039: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: VM30492
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM30492%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for VM30492: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: MJ69210
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for MJ69210: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: AA58136
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA58136%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for AA58136: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: VY21971
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY21971%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for VY21971: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: HT12847
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT12847%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for HT12847: 0
2025-12-05 10:03:43 [auto1.it] INFO: Found listing with ID: GY37830
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2025-12-05 10:03:43 [auto1.it] INFO: Scrape type for GY37830: 2
2025-12-05 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML50616> (referer: https://www.auto1.com/v1/car-details-view/ML50616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW58220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY23026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS34297> (referer: https://www.auto1.com/v1/car-details-view/DS34297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eede50>
2025-12-05 10:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_d0944d1169623a112944a4fe028dbe81.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d0944d1169623a112944a4fe028dbe81.jpg saved to cache
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: PP05492
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for PP05492: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: GK80358
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK80358%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for GK80358: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: LU84839
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU84839%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for LU84839: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: RY76570
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for RY76570: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: SF52848
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF52848%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for SF52848: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: FA34610
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA34610%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for FA34610: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: DY32635
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY32635%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for DY32635: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: AH77944
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH77944%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for AH77944: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: GY99186
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY99186%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for GY99186: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: WS74812
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS74812%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for WS74812: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: HX12723
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX12723%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for HX12723: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: LN27562
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN27562%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for LN27562: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: NZ22427
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ22427%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for NZ22427: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: RX64693
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX64693%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for RX64693: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: SH42553
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH42553%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for SH42553: 0
2025-12-05 10:03:44 [auto1.it] INFO: Found listing with ID: MD30799
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD30799%27 HTTP/1.1" 200 None
2025-12-05 10:03:44 [auto1.it] INFO: Scrape type for MD30799: 0
2025-12-05 10:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0d4f310>
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_a29c048c40d15aa597edb54cb5d94ced.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_a29c048c40d15aa597edb54cb5d94ced.jpg saved to cache
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with identifier: ML50616
2025-12-05 10:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with scrape type 2
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with scrape type 2
2025-12-05 10:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 430785e7-e8c1-5883-ba0f-47c6ae7ae61f, identifier: ML50616
2025-12-05 10:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e531b7fb-9971-5533-80e7-dc4b3087db39 with identifier: DS34297
2025-12-05 10:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e531b7fb-9971-5533-80e7-dc4b3087db39 with scrape type 2
2025-12-05 10:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e531b7fb-9971-5533-80e7-dc4b3087db39 with scrape type 2
2025-12-05 10:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e531b7fb-9971-5533-80e7-dc4b3087db39, identifier: DS34297
2025-12-05 10:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with identifier: ML50616
2025-12-05 10:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with identifier: ML50616
2025-12-05 10:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 430785e7-e8c1-5883-ba0f-47c6ae7ae61f with identifier: ML50616 to the API
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML50616>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2025-12-05T16:49:59Z',
 'fuel_type': 'petrol',
 'id': '430785e7-e8c1-5883-ba0f-47c6ae7ae61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML50616',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 46970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML50616%27 HTTP/1.1" 200 None
2025-12-05 10:03:45 [auto1.it] INFO: Saving data for ML50616: {'auction_closing_time': 1764953399.0, 'created_time': 1764756063.99414, 'last_price_update_time': 1764929025.592319}
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML50616') HTTP/1.1" 204 0
2025-12-05 10:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e531b7fb-9971-5533-80e7-dc4b3087db39 with identifier: DS34297
2025-12-05 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e531b7fb-9971-5533-80e7-dc4b3087db39 with identifier: DS34297
2025-12-05 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'lynk & co 01 1.5 plug-in hybrid', 'price': 0, 'currency': 'eur', 'make': 'lynk & co', 'model': '01', 'transmission': 'automatic', 'odometer': 40893, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ds34297', 'expiration_date': '2025-12-05t16:12:37z', 'origin_country_code': 'it', 'trim': '', 'year': 2023, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 179, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.5l', 'location': 'it', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 24, 'id': 'e531b7fb-9971-5533-80e7-dc4b3087db39', 'current_year_diff': 2, 'age_in_months': 31, 'make_model': 'lynk & co 01', 'sanitized_make': 'lynkco', 'odometer_in_km': 40893}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'engine_horse_power': 179,
     'expiration_date': '2025-12-05t16:12:37z',
     'fuel_type': 'hybrid',
     'id': 'e531b7fb-9971-5533-80e7-dc4b3087db39',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ds34297',
     'listing': 'auction',
     'location': 'it',
     'make': 'lynk & co',
     'make_model': 'lynk & co 01',
     'model': '01',
     'odometer': 40893,
     'odometer_in_km': 40893,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-02',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 01 1.5 plug-in hybrid',
     'transmission': 'automatic',
     'trim': '',
     'year': 2023}
2025-12-05 10:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: e531b7fb-9971-5533-80e7-dc4b3087db39 spider: auto1.it
2025-12-05 10:03:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e531b7fb-9971-5533-80e7-dc4b3087db39 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'lynk & co 01 1.5 plug-in hybrid', 'price': 0, 'currency': 'eur', 'make': 'lynk & co', 'model': '01', 'transmission': 'automatic', 'odometer': 40893, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ds34297', 'expiration_date': '2025-12-05t16:12:37z', 'origin_country_code': 'it', 'trim': '', 'year': 2023, 'fuel_type': 'hybrid', 'listing': 'auction', 'engine_horse_power': 179, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.5l', 'location': 'it', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 24, 'id': 'e531b7fb-9971-5533-80e7-dc4b3087db39', 'current_year_diff': 2, 'age_in_months': 31, 'make_model': 'lynk & co 01', 'sanitized_make': 'lynkco', 'odometer_in_km': 40893}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': 24,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'engine_horse_power': 179,
     'expiration_date': '2025-12-05t16:12:37z',
     'fuel_type': 'hybrid',
     'id': 'e531b7fb-9971-5533-80e7-dc4b3087db39',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ds34297',
     'listing': 'auction',
     'location': 'it',
     'make': 'lynk & co',
     'make_model': 'lynk & co 01',
     'model': '01',
     'odometer': 40893,
     'odometer_in_km': 40893,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-05-02',
     'sanitized_make': 'lynkco',
     'seats_number': 5,
     'seller_name': None,
     'title': 'lynk & co 01 1.5 plug-in hybrid',
     'transmission': 'automatic',
     'trim': '',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 179,
 'expiration_date': '2025-12-05T16:12:37Z',
 'fuel_type': 'hybrid',
 'id': 'e531b7fb-9971-5533-80e7-dc4b3087db39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS34297',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 40893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS34297%27 HTTP/1.1" 200 None
2025-12-05 10:03:45 [auto1.it] INFO: Saving data for DS34297: {'auction_closing_time': 1764951157.0, 'created_time': 1764756130.348811, 'last_price_update_time': 1764929025.924683}
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS34297') HTTP/1.1" 204 0
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT18742> (referer: https://www.auto1.com/v1/car-details-view/KT18742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF25118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK46480> (referer: https://www.auto1.com/v1/car-details-view/XK46480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR27447> (referer: https://www.auto1.com/v1/car-details-view/NR27447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_43c3417676362decfcf22c1be10d0c75.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8c398f0b10b2a04889077f379caf7c53.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_acc5f109cffa93e66246f29c7bc9c077.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_aa963f5aa691fa7966feac847248c392.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_919ec27075bd96a881404e2daf798e24.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2025-12-05 10:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f, identifier: KT18742
2025-12-05 10:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2025-12-05 10:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2025-12-05 10:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135143 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135143
2025-12-05 10:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f spider: auto1.it
2025-12-05 10:03:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f due to rule: high_mileage_for_make.json, error: 135143 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135143
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-05T16:45:42Z',
 'fuel_type': 'petrol',
 'id': 'cad25720-24d2-5e8b-8d9a-6f2a82f24e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT18742',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 135143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT18742%27 HTTP/1.1" 200 None
2025-12-05 10:03:46 [auto1.it] INFO: Saving data for KT18742: {'auction_closing_time': 1764953142.0, 'created_time': 1764662441.76139, 'last_price_update_time': 1764929026.354315}
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT18742') HTTP/1.1" 204 0
2025-12-05 10:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00661cc1-3a7e-5430-9336-2be0e97a09e6 with identifier: XK46480
2025-12-05 10:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00661cc1-3a7e-5430-9336-2be0e97a09e6 with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00661cc1-3a7e-5430-9336-2be0e97a09e6 with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00661cc1-3a7e-5430-9336-2be0e97a09e6, identifier: XK46480
2025-12-05 10:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c257a3b-2848-5825-8469-2db5435319ad with identifier: NR27447
2025-12-05 10:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c257a3b-2848-5825-8469-2db5435319ad with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c257a3b-2848-5825-8469-2db5435319ad with scrape type 2
2025-12-05 10:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c257a3b-2848-5825-8469-2db5435319ad, identifier: NR27447
2025-12-05 10:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33b0910>
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg saved to cache
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d87110>
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_43c3417676362decfcf22c1be10d0c75.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_43c3417676362decfcf22c1be10d0c75.jpg saved to cache
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e661d0>
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_8c398f0b10b2a04889077f379caf7c53.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8c398f0b10b2a04889077f379caf7c53.jpg saved to cache
2025-12-05 10:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0092050>
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_acc5f109cffa93e66246f29c7bc9c077.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_acc5f109cffa93e66246f29c7bc9c077.jpg saved to cache
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0093ed0>
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_aa963f5aa691fa7966feac847248c392.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_aa963f5aa691fa7966feac847248c392.jpg saved to cache
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d21e10>
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F87%252Fd587a9cdbda194f5ac4b2a3791019135%252Fpa%252FHW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg saved to cache
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02c03521-5916-5702-a67c-2def21d5f964
2025-12-05 10:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02c03521-5916-5702-a67c-2def21d5f964, skipping ID generation
2025-12-05 10:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c03521-5916-5702-a67c-2def21d5f964 with scrape type 1
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 02c03521-5916-5702-a67c-2def21d5f964 from tracking dictionaries
2025-12-05 10:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02c03521-5916-5702-a67c-2def21d5f964 sending to next pipeline
2025-12-05 10:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02c03521-5916-5702-a67c-2def21d5f964, identifier: HW99743
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db00969d0>
2025-12-05 10:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fb1%252Ff3b1caa70a441ccaf858daf8aa449271%252Fpa%252FKC69548_919ec27075bd96a881404e2daf798e24.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_919ec27075bd96a881404e2daf798e24.jpg saved to cache
2025-12-05 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb301f23-b846-59b8-a80a-d0c1b587a519
2025-12-05 10:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb301f23-b846-59b8-a80a-d0c1b587a519, skipping ID generation
2025-12-05 10:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb301f23-b846-59b8-a80a-d0c1b587a519 with scrape type 1
2025-12-05 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fb301f23-b846-59b8-a80a-d0c1b587a519 from tracking dictionaries
2025-12-05 10:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb301f23-b846-59b8-a80a-d0c1b587a519 sending to next pipeline
2025-12-05 10:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb301f23-b846-59b8-a80a-d0c1b587a519, identifier: KC69548
2025-12-05 10:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00661cc1-3a7e-5430-9336-2be0e97a09e6 with identifier: XK46480
2025-12-05 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00661cc1-3a7e-5430-9336-2be0e97a09e6 with identifier: XK46480
2025-12-05 10:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00661cc1-3a7e-5430-9336-2be0e97a09e6 with identifier: XK46480 to the API
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK46480>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2025-12-05T16:13:27Z',
 'fuel_type': 'hybrid',
 'id': '00661cc1-3a7e-5430-9336-2be0e97a09e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK46480',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 62307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK46480%27 HTTP/1.1" 200 None
2025-12-05 10:03:49 [auto1.it] INFO: Saving data for XK46480: {'auction_closing_time': 1764951207.0, 'created_time': 1764756063.01103, 'last_price_update_time': 1764929029.638119}
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK46480') HTTP/1.1" 204 0
2025-12-05 10:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c257a3b-2848-5825-8469-2db5435319ad with identifier: NR27447
2025-12-05 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c257a3b-2848-5825-8469-2db5435319ad with identifier: NR27447
2025-12-05 10:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c257a3b-2848-5825-8469-2db5435319ad with identifier: NR27447 to the API
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR27447>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-06T16:08:29Z',
 'fuel_type': 'petrol',
 'id': '8c257a3b-2848-5825-8469-2db5435319ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR27447',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 62825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR27447%27 HTTP/1.1" 200 None
2025-12-05 10:03:49 [auto1.it] INFO: Saving data for NR27447: {'auction_closing_time': 1765037309.0, 'created_time': 1764101007.337192, 'last_price_update_time': 1764929029.979497}
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR27447') HTTP/1.1" 204 0
2025-12-05 10:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02c03521-5916-5702-a67c-2def21d5f964 with identifier: HW99743
2025-12-05 10:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02c03521-5916-5702-a67c-2def21d5f964 with identifier: HW99743
2025-12-05 10:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
2025-12-05 10:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 02c03521-5916-5702-a67c-2def21d5f964 spider: auto1.it
2025-12-05 10:03:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 02c03521-5916-5702-a67c-2def21d5f964 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'dokker' containing 'dokker'
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-06T16:23:56Z',
 'fuel_type': 'diesel',
 'id': '02c03521-5916-5702-a67c-2def21d5f964',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW99743',
 'listing': 'auction',
 'location': "IT, Cassano D'Adda",
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 141817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8402d63bd71bb38e3db0a34f8b4e4ee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754051,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0117445c4404dc03b2dba0aa658e1151.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_8c398f0b10b2a04889077f379caf7c53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_2c6a237f41cd9bbf4ee814ddcb2dfaa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_4ce63f07402a120bdcbed54ecb3d9ecb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_0cc302dc06773eeb43f8011d30bd4109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_ac2e56b37985e77f86e2f2786167fff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6a6d372ccaf671a91784159ef1613034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_c78706eafb96ff0f2bdd467a9e51bdc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_13a97e8229e31f070595796bb9893125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_6b6a9749ddb55915f8a9de861f19c406.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_a6314e6be5932cd371970360ba6f6f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_9831ab6ab0318499bffe7b7dbb5cd918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576893,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_46d6b036d35996d409c1d07e0ae69884.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02c03521-5916-5702-a67c-2def21d5f964/02c03521-5916-5702-a67c-2def21d5f964_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/87/d587a9cdbda194f5ac4b2a3791019135/pa/HW99743_aecf187df633434e0cef9f6c11d158a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Dacia Dokker 1.5 dCi Diesel Brave',
 'transmission': 'manual',
 'trim': 'Brave',
 'year': 2017}
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99743%27 HTTP/1.1" 200 None
2025-12-05 10:03:50 [auto1.it] INFO: Saving data for HW99743: {'created_time': 1764929030.196078, 'last_price_update_time': 1764929030.19609, 'auction_closing_time': 1765038236.0}
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW99743') HTTP/1.1" 204 0
2025-12-05 10:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb301f23-b846-59b8-a80a-d0c1b587a519 with identifier: KC69548
2025-12-05 10:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb301f23-b846-59b8-a80a-d0c1b587a519 with identifier: KC69548
2025-12-05 10:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb301f23-b846-59b8-a80a-d0c1b587a519 with identifier: KC69548 to the API
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_919ec27075bd96a881404e2daf798e24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-06T16:42:51Z',
 'fuel_type': 'gas',
 'id': 'fb301f23-b846-59b8-a80a-d0c1b587a519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC69548',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 42119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_919ec27075bd96a881404e2daf798e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_a29c048c40d15aa597edb54cb5d94ced.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d70afd9d0c13d30ec7831ace5eca803e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8eb01cdb9b23ccc2d4af10e3a9497a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_57ff15223d4884e1045e665fc420da5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_44ac21cc4e3de0cf1363675094a3e065.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2289157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_8dc8d9ecbcd6aaee7c82b6a67601796b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_0d02cc821f84dde61d78e4460c5998b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_2f4f97d550ef0336a44e03d023a3ddc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d270270bdfd68e6b28e5d80fbc6b1f81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2165443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_7d823f43950f52e8099d889bc3fcf085.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_f3a701235e44ee189055c4e392818b86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_eb3cfea88392297106f07c80bf51c215.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1934997,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_45cb6393f278aee1cd2501af6275f611.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb301f23-b846-59b8-a80a-d0c1b587a519/fb301f23-b846-59b8-a80a-d0c1b587a519_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/b1/f3b1caa70a441ccaf858daf8aa449271/pa/KC69548_d6fe6491c6f142c05251574c99bd7a40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression',
 'transmission': 'manual',
 'trim': 'Stepway Expression',
 'year': 2023}
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC69548%27 HTTP/1.1" 200 None
2025-12-05 10:03:50 [auto1.it] INFO: Saving data for KC69548: {'created_time': 1764929030.681261, 'last_price_update_time': 1764929030.681273, 'auction_closing_time': 1765039371.0}
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC69548') HTTP/1.1" 204 0
2025-12-05 10:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY37830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB75182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM40401> (referer: https://www.auto1.com/v1/car-details-view/PM40401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with identifier: PM40401
2025-12-05 10:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with scrape type 2
2025-12-05 10:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with scrape type 2
2025-12-05 10:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb, identifier: PM40401
2025-12-05 10:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with identifier: PM40401
2025-12-05 10:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with identifier: PM40401
2025-12-05 10:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 229c9acf-ee57-50a4-9dcb-d62c0eb72aeb with identifier: PM40401 to the API
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM40401>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2025-12-06T16:02:16Z',
 'fuel_type': 'petrol',
 'id': '229c9acf-ee57-50a4-9dcb-d62c0eb72aeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM40401',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 57752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Dualcolor ISG',
 'transmission': 'manual',
 'trim': 'Dualcolor ISG',
 'year': 2018}
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM40401%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Saving data for PM40401: {'auction_closing_time': 1765036936.0, 'created_time': 1763755383.943118, 'last_price_update_time': 1764929031.375668}
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM40401') HTTP/1.1" 204 0
2025-12-05 10:03:51 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: CL25857
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL25857%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for CL25857: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: WS13425
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS13425%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for WS13425: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: HU42841
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU42841%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for HU42841: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: BD83076
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD83076%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for BD83076: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: NG04038
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG04038%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for NG04038: 2
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: VR69753
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR69753%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for VR69753: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: UR43177
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR43177%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for UR43177: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: EF52156
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF52156%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for EF52156: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: EE48211
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE48211%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for EE48211: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: PC51433
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC51433%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for PC51433: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: SE73703
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE73703%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for SE73703: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: MW42413
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW42413%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for MW42413: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: HY15868
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY15868%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for HY15868: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: ZT81804
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT81804%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for ZT81804: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: RX73287
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX73287%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for RX73287: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: EK48901
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK48901%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for EK48901: 2
2025-12-05 10:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU69330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV96232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: JK10919
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK10919%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for JK10919: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: BN21730
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN21730%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for BN21730: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: DU87329
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU87329%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for DU87329: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: WJ05093
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ05093%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for WJ05093: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: DZ26704
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ26704%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for DZ26704: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: TZ32899
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ32899%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for TZ32899: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: XB39028
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB39028%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for XB39028: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: HV38513
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for HV38513: 2
2025-12-05 10:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: FV28037
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28037%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for FV28037: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: FV65122
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV65122%27 HTTP/1.1" 200 None
2025-12-05 10:03:51 [auto1.it] INFO: Scrape type for FV65122: 0
2025-12-05 10:03:51 [auto1.it] INFO: Found listing with ID: WP61261
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP61261%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for WP61261: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: MU47975
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU47975%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for MU47975: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: FJ53404
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ53404%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for FJ53404: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: VX24318
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX24318%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for VX24318: 2
2025-12-05 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY23026> (referer: https://www.auto1.com/v1/car-details-view/GY23026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: CW29796
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW29796%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for CW29796: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: XB16369
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB16369%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for XB16369: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: KW26134
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for KW26134: 2
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: DV77593
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV77593%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for DV77593: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: HE46295
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for HE46295: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: PZ30408
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ30408%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for PZ30408: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: WZ62435
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ62435%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for WZ62435: 0
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: KK64864
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for KK64864: 2
2025-12-05 10:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK91681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: TB06647
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB06647%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for TB06647: 2
2025-12-05 10:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:52 [auto1.it] INFO: Found listing with ID: UP05392
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP05392%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Scrape type for UP05392: 0
2025-12-05 10:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with identifier: GY23026
2025-12-05 10:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with scrape type 2
2025-12-05 10:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with scrape type 2
2025-12-05 10:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6, identifier: GY23026
2025-12-05 10:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with identifier: GY23026
2025-12-05 10:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with identifier: GY23026
2025-12-05 10:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6 with identifier: GY23026 to the API
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY23026>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '2.8L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-06T16:01:02Z',
 'fuel_type': 'diesel',
 'id': 'e73599d3-0856-50c1-aaeb-8fcfb0d0e3f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY23026',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 66417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2017}
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY23026%27 HTTP/1.1" 200 None
2025-12-05 10:03:52 [auto1.it] INFO: Saving data for GY23026: {'auction_closing_time': 1765036862.0, 'created_time': 1764101037.296626, 'last_price_update_time': 1764929032.973745}
2025-12-05 10:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY23026') HTTP/1.1" 204 0
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW58220> (referer: https://www.auto1.com/v1/car-details-view/SW58220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA20233> (referer: https://www.auto1.com/v1/car-details-view/JA20233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF25118> (referer: https://www.auto1.com/v1/car-details-view/ZF25118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX50050/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG22278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db434f05-7345-519f-ac6c-883c32aa1f5c with identifier: SW58220
2025-12-05 10:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db434f05-7345-519f-ac6c-883c32aa1f5c with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db434f05-7345-519f-ac6c-883c32aa1f5c with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db434f05-7345-519f-ac6c-883c32aa1f5c, identifier: SW58220
2025-12-05 10:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db434f05-7345-519f-ac6c-883c32aa1f5c with identifier: SW58220
2025-12-05 10:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db434f05-7345-519f-ac6c-883c32aa1f5c with identifier: SW58220
2025-12-05 10:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db434f05-7345-519f-ac6c-883c32aa1f5c with identifier: SW58220 to the API
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27db434f05-7345-519f-ac6c-883c32aa1f5c%27 HTTP/1.1" 200 None
2025-12-05 10:03:53 [crawlers.pipelines.post_to_api] ERROR: auto1.it, item_id db434f05-7345-519f-ac6c-883c32aa1f5c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 10:03:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 10:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW58220>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-06T16:58:16Z',
 'fuel_type': 'diesel',
 'id': 'db434f05-7345-519f-ac6c-883c32aa1f5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW58220',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 39910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW58220%27 HTTP/1.1" 200 None
2025-12-05 10:03:53 [auto1.it] INFO: Saving data for SW58220: {'auction_closing_time': 1765040296.0, 'created_time': 1764187235.299613, 'last_price_update_time': 1764929033.624731}
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SW58220') HTTP/1.1" 204 0
2025-12-05 10:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4beded85-6578-502e-b554-533df11047ac with identifier: JA20233
2025-12-05 10:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4beded85-6578-502e-b554-533df11047ac with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4beded85-6578-502e-b554-533df11047ac with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4beded85-6578-502e-b554-533df11047ac, identifier: JA20233
2025-12-05 10:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5281a5b-e387-5b70-8823-04da9e74b487 with identifier: ZF25118
2025-12-05 10:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5281a5b-e387-5b70-8823-04da9e74b487 with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5281a5b-e387-5b70-8823-04da9e74b487 with scrape type 2
2025-12-05 10:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5281a5b-e387-5b70-8823-04da9e74b487, identifier: ZF25118
2025-12-05 10:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da333a950>
2025-12-05 10:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F98%252F6198c2d02a7366f8362480843097e2f1%252Fpa%252FEC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg') HTTP/1.1" 204 0
2025-12-05 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg saved to cache
2025-12-05 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6
2025-12-05 10:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6, skipping ID generation
2025-12-05 10:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with scrape type 1
2025-12-05 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 from tracking dictionaries
2025-12-05 10:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 sending to next pipeline
2025-12-05 10:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6, identifier: EC73786
2025-12-05 10:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4beded85-6578-502e-b554-533df11047ac with identifier: JA20233
2025-12-05 10:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4beded85-6578-502e-b554-533df11047ac with identifier: JA20233
2025-12-05 10:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 10:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4beded85-6578-502e-b554-533df11047ac spider: auto1.it
2025-12-05 10:03:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4beded85-6578-502e-b554-533df11047ac due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-06T16:23:55Z',
 'fuel_type': 'petrol',
 'id': '4beded85-6578-502e-b554-533df11047ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA20233',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 14431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA20233%27 HTTP/1.1" 200 None
2025-12-05 10:03:54 [auto1.it] INFO: Saving data for JA20233: {'auction_closing_time': 1765038235.0, 'created_time': 1763755548.649601, 'last_price_update_time': 1764929034.592942}
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA20233') HTTP/1.1" 204 0
2025-12-05 10:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5281a5b-e387-5b70-8823-04da9e74b487 with identifier: ZF25118
2025-12-05 10:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5281a5b-e387-5b70-8823-04da9e74b487 with identifier: ZF25118
2025-12-05 10:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5281a5b-e387-5b70-8823-04da9e74b487 with identifier: ZF25118 to the API
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF25118>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:11:47Z',
 'fuel_type': 'petrol',
 'id': 'a5281a5b-e387-5b70-8823-04da9e74b487',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF25118',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 86746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2017}
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF25118%27 HTTP/1.1" 200 None
2025-12-05 10:03:54 [auto1.it] INFO: Saving data for ZF25118: {'auction_closing_time': 1765037507.0, 'created_time': 1764101352.837214, 'last_price_update_time': 1764929034.929638}
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF25118') HTTP/1.1" 204 0
2025-12-05 10:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with identifier: EC73786
2025-12-05 10:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with identifier: EC73786
2025-12-05 10:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42fd211d-1bc2-503c-9a4c-aab1ce02ddf6 with identifier: EC73786 to the API
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:42:17Z',
 'fuel_type': 'diesel',
 'id': '42fd211d-1bc2-503c-9a4c-aab1ce02ddf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC73786',
 'listing': 'auction',
 'location': 'IT, Cinisello Balsamo',
 'make': 'BMW',
 'model': '5er',
 'odometer': 146297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_996772bd21b52fe0adb5dd08a924d3ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947130,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_aa963f5aa691fa7966feac847248c392.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d0944d1169623a112944a4fe028dbe81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032263,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_acc5f109cffa93e66246f29c7bc9c077.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_88451015b9df53fd32ea727f85bbca6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_4dbdeadec1db0a33fc42abbcdbba44e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3057873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_43c3417676362decfcf22c1be10d0c75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_febc54288a87d7c166d9d88671e4d0d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_d29072a81febb5e804654ad051b515a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_1a6f9c72b8e3d1ad82e414cda263428c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_58a818150817b40b15b33eb50dd7766b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039111,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_7153d65306fbb95a8df8e40762f0d8de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_b3592bece7e0ddaf34bde63e737fcf2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_bf081c7f3d36912a25a5908d06a16cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42fd211d-1bc2-503c-9a4c-aab1ce02ddf6/42fd211d-1bc2-503c-9a4c-aab1ce02ddf6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/98/6198c2d02a7366f8362480843097e2f1/pa/EC73786_47f6b9639855be93e69159c9b032ef12.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC73786%27 HTTP/1.1" 200 None
2025-12-05 10:03:55 [auto1.it] INFO: Saving data for EC73786: {'created_time': 1764929035.330367, 'last_price_update_time': 1764929035.330379, 'auction_closing_time': 1765039337.0}
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC73786') HTTP/1.1" 204 0
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR31732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG34096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY39910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU30700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB92663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG04038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK64864/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV38513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB06647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK48901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK91681> (referer: https://www.auto1.com/v1/car-details-view/BK91681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07cee286-f9cb-54a0-bfed-2695cec6bdb5 with identifier: BK91681
2025-12-05 10:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07cee286-f9cb-54a0-bfed-2695cec6bdb5 with scrape type 2
2025-12-05 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07cee286-f9cb-54a0-bfed-2695cec6bdb5 with scrape type 2
2025-12-05 10:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07cee286-f9cb-54a0-bfed-2695cec6bdb5, identifier: BK91681
2025-12-05 10:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07cee286-f9cb-54a0-bfed-2695cec6bdb5 with identifier: BK91681
2025-12-05 10:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07cee286-f9cb-54a0-bfed-2695cec6bdb5 with identifier: BK91681
2025-12-05 10:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153330 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153330
2025-12-05 10:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 07cee286-f9cb-54a0-bfed-2695cec6bdb5 spider: auto1.it
2025-12-05 10:03:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 07cee286-f9cb-54a0-bfed-2695cec6bdb5 due to rule: high_mileage_for_country.json, error: 153330 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153330
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-05T16:52:47Z',
 'fuel_type': 'diesel',
 'id': '07cee286-f9cb-54a0-bfed-2695cec6bdb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK91681',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 153330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 DI-D Invite 2WD',
 'transmission': 'manual',
 'trim': 'Invite 2WD',
 'year': 2017}
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK91681%27 HTTP/1.1" 200 None
2025-12-05 10:03:57 [auto1.it] INFO: Saving data for BK91681: {'auction_closing_time': 1764953567.0, 'created_time': 1762804852.798266, 'last_price_update_time': 1764929037.459364}
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK91681') HTTP/1.1" 204 0
2025-12-05 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF14227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV96232> (referer: https://www.auto1.com/v1/car-details-view/RV96232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with identifier: RV96232
2025-12-05 10:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with scrape type 2
2025-12-05 10:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with scrape type 2
2025-12-05 10:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af3b4032-7963-5ca7-8af2-1b38a2fddbb2, identifier: RV96232
2025-12-05 10:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with identifier: RV96232
2025-12-05 10:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with identifier: RV96232
2025-12-05 10:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af3b4032-7963-5ca7-8af2-1b38a2fddbb2 with identifier: RV96232 to the API
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV96232>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-05T16:22:44Z',
 'fuel_type': 'diesel',
 'id': 'af3b4032-7963-5ca7-8af2-1b38a2fddbb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV96232',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 104447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV96232%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Saving data for RV96232: {'auction_closing_time': 1764951764.0, 'created_time': 1764756203.905515, 'last_price_update_time': 1764929038.052427}
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV96232') HTTP/1.1" 204 0
2025-12-05 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW26134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX24318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX50050> (referer: https://www.auto1.com/v1/car-details-view/LX50050/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ab206d-5fac-506d-9677-bf06e80a4c2e with identifier: LX50050
2025-12-05 10:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ab206d-5fac-506d-9677-bf06e80a4c2e with scrape type 2
2025-12-05 10:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ab206d-5fac-506d-9677-bf06e80a4c2e with scrape type 2
2025-12-05 10:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41ab206d-5fac-506d-9677-bf06e80a4c2e, identifier: LX50050
2025-12-05 10:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41ab206d-5fac-506d-9677-bf06e80a4c2e with identifier: LX50050
2025-12-05 10:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41ab206d-5fac-506d-9677-bf06e80a4c2e with identifier: LX50050
2025-12-05 10:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41ab206d-5fac-506d-9677-bf06e80a4c2e with identifier: LX50050 to the API
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX50050>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:39:28Z',
 'fuel_type': 'diesel',
 'id': '41ab206d-5fac-506d-9677-bf06e80a4c2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX50050',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 76216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion',
 'transmission': 'automatic',
 'trim': 'Life 4Motion',
 'year': 2021}
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX50050%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Saving data for LX50050: {'auction_closing_time': 1765039168.0, 'created_time': 1764619247.522617, 'last_price_update_time': 1764929038.613625}
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX50050') HTTP/1.1" 204 0
2025-12-05 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU69330> (referer: https://www.auto1.com/v1/car-details-view/PU69330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:58 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:03:58 [auto1.it] INFO: Found listing with ID: LH42493
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH42493%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Scrape type for LH42493: 0
2025-12-05 10:03:58 [auto1.it] INFO: Found listing with ID: HR18451
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR18451%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Scrape type for HR18451: 0
2025-12-05 10:03:58 [auto1.it] INFO: Found listing with ID: PN13750
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN13750%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Scrape type for PN13750: 0
2025-12-05 10:03:58 [auto1.it] INFO: Found listing with ID: WV91613
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91613%27 HTTP/1.1" 200 None
2025-12-05 10:03:58 [auto1.it] INFO: Scrape type for WV91613: 0
2025-12-05 10:03:58 [auto1.it] INFO: Found listing with ID: KW54153
2025-12-05 10:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW54153%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for KW54153: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: FD29488
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD29488%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for FD29488: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: LX26902
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX26902%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for LX26902: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: YK22505
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK22505%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for YK22505: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: YU19851
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for YU19851: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: CK30778
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK30778%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for CK30778: 2
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: KM02872
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for KM02872: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: NE86090
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE86090%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for NE86090: 2
2025-12-05 10:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG22278> (referer: https://www.auto1.com/v1/car-details-view/WG22278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c54c37d9-a18e-5304-964d-895810d15771 with identifier: PU69330
2025-12-05 10:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c54c37d9-a18e-5304-964d-895810d15771 with scrape type 2
2025-12-05 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c54c37d9-a18e-5304-964d-895810d15771 with scrape type 2
2025-12-05 10:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c54c37d9-a18e-5304-964d-895810d15771, identifier: PU69330
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: JL01801
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL01801%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for JL01801: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: JY88451
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY88451%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for JY88451: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: RX96026
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX96026%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for RX96026: 2
2025-12-05 10:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c54c37d9-a18e-5304-964d-895810d15771 with identifier: PU69330
2025-12-05 10:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c54c37d9-a18e-5304-964d-895810d15771 with identifier: PU69330
2025-12-05 10:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194764 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194764
2025-12-05 10:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c54c37d9-a18e-5304-964d-895810d15771 spider: auto1.it
2025-12-05 10:03:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c54c37d9-a18e-5304-964d-895810d15771 due to rule: high_mileage_for_country.json, error: 194764 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194764
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:13:14Z',
 'fuel_type': 'diesel',
 'id': 'c54c37d9-a18e-5304-964d-895810d15771',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU69330',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 194764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU69330%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Saving data for PU69330: {'auction_closing_time': 1764951194.0, 'created_time': 1764662440.137301, 'last_price_update_time': 1764929039.498481}
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU69330') HTTP/1.1" 204 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: RL30055
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for RL30055: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: VP11454
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP11454%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for VP11454: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: VL59630
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL59630%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for VL59630: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: VJ46302
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for VJ46302: 2
2025-12-05 10:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG34096> (referer: https://www.auto1.com/v1/car-details-view/RG34096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY39910> (referer: https://www.auto1.com/v1/car-details-view/NY39910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2025-12-05 10:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4ec92c-8e59-541f-9ce2-49123826fa54 with scrape type 2
2025-12-05 10:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4ec92c-8e59-541f-9ce2-49123826fa54 with scrape type 2
2025-12-05 10:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a4ec92c-8e59-541f-9ce2-49123826fa54, identifier: WG22278
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: RE60377
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE60377%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for RE60377: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: KU28358
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU28358%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for KU28358: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: FL32335
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL32335%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for FL32335: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: ZS37031
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS37031%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for ZS37031: 0
2025-12-05 10:03:59 [auto1.it] INFO: Found listing with ID: BR12056
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR12056%27 HTTP/1.1" 200 None
2025-12-05 10:03:59 [auto1.it] INFO: Scrape type for BR12056: 2
2025-12-05 10:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2025-12-05 10:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278
2025-12-05 10:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a4ec92c-8e59-541f-9ce2-49123826fa54 with identifier: WG22278 to the API
2025-12-05 10:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG22278>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:19:09Z',
 'fuel_type': 'petrol',
 'id': '6a4ec92c-8e59-541f-9ce2-49123826fa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG22278',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 33894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Saving data for WG22278: {'auction_closing_time': 1765037949.0, 'created_time': 1762977643.269073, 'last_price_update_time': 1764929040.356654}
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG22278') HTTP/1.1" 204 0
2025-12-05 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU30700> (referer: https://www.auto1.com/v1/car-details-view/AU30700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:00 [auto1.it] INFO: Found listing with ID: LM28542
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM28542%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Scrape type for LM28542: 0
2025-12-05 10:04:00 [auto1.it] INFO: Found listing with ID: PF60167
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF60167%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Scrape type for PF60167: 0
2025-12-05 10:04:00 [auto1.it] INFO: Found listing with ID: BC61751
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Scrape type for BC61751: 2
2025-12-05 10:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG04038> (referer: https://www.auto1.com/v1/car-details-view/NG04038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:00 [auto1.it] INFO: Found listing with ID: NF45221
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Scrape type for NF45221: 2
2025-12-05 10:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180df912-cc7d-5c38-9fef-0c6394bb0e2b with identifier: RG34096
2025-12-05 10:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180df912-cc7d-5c38-9fef-0c6394bb0e2b with scrape type 2
2025-12-05 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180df912-cc7d-5c38-9fef-0c6394bb0e2b with scrape type 2
2025-12-05 10:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 180df912-cc7d-5c38-9fef-0c6394bb0e2b, identifier: RG34096
2025-12-05 10:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca011ffd-e58d-5bcf-89e9-45472c75eae7 with identifier: NY39910
2025-12-05 10:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca011ffd-e58d-5bcf-89e9-45472c75eae7 with scrape type 2
2025-12-05 10:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca011ffd-e58d-5bcf-89e9-45472c75eae7 with scrape type 2
2025-12-05 10:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca011ffd-e58d-5bcf-89e9-45472c75eae7, identifier: NY39910
2025-12-05 10:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 180df912-cc7d-5c38-9fef-0c6394bb0e2b with identifier: RG34096
2025-12-05 10:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 180df912-cc7d-5c38-9fef-0c6394bb0e2b with identifier: RG34096
2025-12-05 10:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2025-12-05 10:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 180df912-cc7d-5c38-9fef-0c6394bb0e2b spider: auto1.it
2025-12-05 10:04:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 180df912-cc7d-5c38-9fef-0c6394bb0e2b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-06T16:35:58Z',
 'fuel_type': 'diesel',
 'id': '180df912-cc7d-5c38-9fef-0c6394bb0e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG34096',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 107332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2021}
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG34096%27 HTTP/1.1" 200 None
2025-12-05 10:04:00 [auto1.it] INFO: Saving data for RG34096: {'auction_closing_time': 1765038958.0, 'created_time': 1764619412.38797, 'last_price_update_time': 1764929040.990811}
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG34096') HTTP/1.1" 204 0
2025-12-05 10:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca011ffd-e58d-5bcf-89e9-45472c75eae7 with identifier: NY39910
2025-12-05 10:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca011ffd-e58d-5bcf-89e9-45472c75eae7 with identifier: NY39910
2025-12-05 10:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193074 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193074
2025-12-05 10:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ca011ffd-e58d-5bcf-89e9-45472c75eae7 spider: auto1.it
2025-12-05 10:04:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ca011ffd-e58d-5bcf-89e9-45472c75eae7 due to rule: high_mileage_for_country.json, error: 193074 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193074
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:22:44Z',
 'fuel_type': 'diesel',
 'id': 'ca011ffd-e58d-5bcf-89e9-45472c75eae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY39910',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 193074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY39910%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Saving data for NY39910: {'auction_closing_time': 1765038164.0, 'created_time': 1762286604.999024, 'last_price_update_time': 1764929041.340502}
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY39910') HTTP/1.1" 204 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: VW62056
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW62056%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for VW62056: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: JH87226
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH87226%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for JH87226: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: CU64074
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU64074%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for CU64074: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: VV31468
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV31468%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for VV31468: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: RM85367
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM85367%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for RM85367: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: KF08387
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF08387%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for KF08387: 2
2025-12-05 10:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR31732> (referer: https://www.auto1.com/v1/car-details-view/SR31732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK48901> (referer: https://www.auto1.com/v1/car-details-view/EK48901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB92663> (referer: https://www.auto1.com/v1/car-details-view/YB92663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: XX17565
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX17565%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for XX17565: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: BR17368
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR17368%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for BR17368: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: PV59531
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59531%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for PV59531: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: FN45149
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN45149%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for FN45149: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: HV52573
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV52573%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for HV52573: 0
2025-12-05 10:04:01 [auto1.it] INFO: Found listing with ID: GF33342
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF33342%27 HTTP/1.1" 200 None
2025-12-05 10:04:01 [auto1.it] INFO: Scrape type for GF33342: 2
2025-12-05 10:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61569fef-150e-50ca-a527-d06a7caf319d with identifier: AU30700
2025-12-05 10:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61569fef-150e-50ca-a527-d06a7caf319d with scrape type 2
2025-12-05 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61569fef-150e-50ca-a527-d06a7caf319d with scrape type 2
2025-12-05 10:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61569fef-150e-50ca-a527-d06a7caf319d, identifier: AU30700
2025-12-05 10:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with identifier: NG04038
2025-12-05 10:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with scrape type 2
2025-12-05 10:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with scrape type 2
2025-12-05 10:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f, identifier: NG04038
2025-12-05 10:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61569fef-150e-50ca-a527-d06a7caf319d with identifier: AU30700
2025-12-05 10:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61569fef-150e-50ca-a527-d06a7caf319d with identifier: AU30700
2025-12-05 10:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61569fef-150e-50ca-a527-d06a7caf319d with identifier: AU30700 to the API
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU30700>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-06T16:38:30Z',
 'fuel_type': 'hybrid',
 'id': '61569fef-150e-50ca-a527-d06a7caf319d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU30700',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 67751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU30700%27 HTTP/1.1" 200 None
2025-12-05 10:04:02 [auto1.it] INFO: Saving data for AU30700: {'auction_closing_time': 1765039110.0, 'created_time': 1763755244.93026, 'last_price_update_time': 1764929042.409417}
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU30700') HTTP/1.1" 204 0
2025-12-05 10:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with identifier: NG04038
2025-12-05 10:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with identifier: NG04038
2025-12-05 10:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9aeaaee-3ff3-5b2a-adfb-63017dc3d61f with identifier: NG04038 to the API
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG04038>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-05T16:15:14Z',
 'fuel_type': 'gas',
 'id': 'd9aeaaee-3ff3-5b2a-adfb-63017dc3d61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG04038',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 142437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2019}
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG04038%27 HTTP/1.1" 200 None
2025-12-05 10:04:03 [auto1.it] INFO: Saving data for NG04038: {'auction_closing_time': 1764951314.0, 'created_time': 1764748861.1502, 'last_price_update_time': 1764929043.010572}
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG04038') HTTP/1.1" 204 0
2025-12-05 10:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64013a69-499b-547e-a42a-60a1ecfde0ed with identifier: SR31732
2025-12-05 10:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64013a69-499b-547e-a42a-60a1ecfde0ed with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64013a69-499b-547e-a42a-60a1ecfde0ed with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64013a69-499b-547e-a42a-60a1ecfde0ed, identifier: SR31732
2025-12-05 10:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a9c081-138a-57d2-b70b-24e564f24c00 with identifier: EK48901
2025-12-05 10:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a9c081-138a-57d2-b70b-24e564f24c00 with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81a9c081-138a-57d2-b70b-24e564f24c00 with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81a9c081-138a-57d2-b70b-24e564f24c00, identifier: EK48901
2025-12-05 10:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2025-12-05 10:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd67007f-1836-5a49-847c-8bf480dbd91d with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd67007f-1836-5a49-847c-8bf480dbd91d with scrape type 2
2025-12-05 10:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd67007f-1836-5a49-847c-8bf480dbd91d, identifier: YB92663
2025-12-05 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB06647> (referer: https://www.auto1.com/v1/car-details-view/TB06647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV38513> (referer: https://www.auto1.com/v1/car-details-view/HV38513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64013a69-499b-547e-a42a-60a1ecfde0ed with identifier: SR31732
2025-12-05 10:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64013a69-499b-547e-a42a-60a1ecfde0ed with identifier: SR31732
2025-12-05 10:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64013a69-499b-547e-a42a-60a1ecfde0ed with identifier: SR31732 to the API
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR31732>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2025-12-06T16:52:59Z',
 'fuel_type': 'diesel',
 'id': '64013a69-499b-547e-a42a-60a1ecfde0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR31732',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 130017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-04',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR31732%27 HTTP/1.1" 200 None
2025-12-05 10:04:03 [auto1.it] INFO: Saving data for SR31732: {'auction_closing_time': 1765039979.0, 'created_time': 1763669265.92644, 'last_price_update_time': 1764929043.750535}
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR31732') HTTP/1.1" 204 0
2025-12-05 10:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81a9c081-138a-57d2-b70b-24e564f24c00 with identifier: EK48901
2025-12-05 10:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81a9c081-138a-57d2-b70b-24e564f24c00 with identifier: EK48901
2025-12-05 10:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 81a9c081-138a-57d2-b70b-24e564f24c00 with identifier: EK48901 to the API
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK48901>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '81a9c081-138a-57d2-b70b-24e564f24c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK48901',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 36911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK48901%27 HTTP/1.1" 200 None
2025-12-05 10:04:04 [auto1.it] INFO: Saving data for EK48901: {'auction_closing_time': 1764950954.0, 'created_time': 1764756183.782636, 'last_price_update_time': 1764929044.102056}
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK48901') HTTP/1.1" 204 0
2025-12-05 10:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2025-12-05 10:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2025-12-05 10:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663 to the API
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27cd67007f-1836-5a49-847c-8bf480dbd91d%27 HTTP/1.1" 200 None
2025-12-05 10:04:04 [crawlers.pipelines.post_to_api] ERROR: auto1.it, item_id cd67007f-1836-5a49-847c-8bf480dbd91d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Fri, 05 Dec 2025 10:04:03 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-05 10:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB92663>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2025-12-06T16:16:15Z',
 'fuel_type': 'diesel',
 'id': 'cd67007f-1836-5a49-847c-8bf480dbd91d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB92663',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 106480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2018}
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2025-12-05 10:04:04 [auto1.it] INFO: Saving data for YB92663: {'auction_closing_time': 1765037775.0, 'created_time': 1764619312.806467, 'last_price_update_time': 1764929044.443475}
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB92663') HTTP/1.1" 204 0
2025-12-05 10:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB75182> (referer: https://www.auto1.com/v1/car-details-view/GB75182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF14227> (referer: https://www.auto1.com/v1/car-details-view/DF14227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK64864> (referer: https://www.auto1.com/v1/car-details-view/KK64864/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with identifier: TB06647
2025-12-05 10:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with scrape type 2
2025-12-05 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with scrape type 2
2025-12-05 10:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94bd399c-8c54-59bc-a36f-ea302c8d1d41, identifier: TB06647
2025-12-05 10:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e370d121-8c46-54f5-8083-0d81615e0fe9 with identifier: HV38513
2025-12-05 10:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e370d121-8c46-54f5-8083-0d81615e0fe9 with scrape type 2
2025-12-05 10:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e370d121-8c46-54f5-8083-0d81615e0fe9 with scrape type 2
2025-12-05 10:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e370d121-8c46-54f5-8083-0d81615e0fe9, identifier: HV38513
2025-12-05 10:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with identifier: TB06647
2025-12-05 10:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with identifier: TB06647
2025-12-05 10:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94bd399c-8c54-59bc-a36f-ea302c8d1d41 with identifier: TB06647 to the API
2025-12-05 10:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB06647>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'expiration_date': '2025-12-05T16:21:09Z',
 'fuel_type': 'gas',
 'id': '94bd399c-8c54-59bc-a36f-ea302c8d1d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB06647',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'DR',
 'model': 'DR 3.0',
 'odometer': 8674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 3.0 1.5 LPG',
 'transmission': 'manual',
 'trim': '',
 'year': 2025}
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB06647%27 HTTP/1.1" 200 None
2025-12-05 10:04:05 [auto1.it] INFO: Saving data for TB06647: {'auction_closing_time': 1764951669.0, 'created_time': 1764748859.919103, 'last_price_update_time': 1764929045.382829}
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB06647') HTTP/1.1" 204 0
2025-12-05 10:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e370d121-8c46-54f5-8083-0d81615e0fe9 with identifier: HV38513
2025-12-05 10:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e370d121-8c46-54f5-8083-0d81615e0fe9 with identifier: HV38513
2025-12-05 10:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194640 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194640
2025-12-05 10:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e370d121-8c46-54f5-8083-0d81615e0fe9 spider: auto1.it
2025-12-05 10:04:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e370d121-8c46-54f5-8083-0d81615e0fe9 due to rule: high_mileage_for_country.json, error: 194640 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194640
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-05T16:59:22Z',
 'fuel_type': 'diesel',
 'id': 'e370d121-8c46-54f5-8083-0d81615e0fe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV38513',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 194640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC AMG Sport',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Sport',
 'year': 2017}
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV38513%27 HTTP/1.1" 200 None
2025-12-05 10:04:05 [auto1.it] INFO: Saving data for HV38513: {'auction_closing_time': 1764953962.0, 'created_time': 1763064321.674509, 'last_price_update_time': 1764929045.679712}
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HV38513') HTTP/1.1" 204 0
2025-12-05 10:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e with identifier: GB75182
2025-12-05 10:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e with scrape type 2
2025-12-05 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e with scrape type 2
2025-12-05 10:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e, identifier: GB75182
2025-12-05 10:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89779d0f-377a-5b43-8768-cf79b1daf1db with identifier: DF14227
2025-12-05 10:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89779d0f-377a-5b43-8768-cf79b1daf1db with scrape type 2
2025-12-05 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89779d0f-377a-5b43-8768-cf79b1daf1db with scrape type 2
2025-12-05 10:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89779d0f-377a-5b43-8768-cf79b1daf1db, identifier: DF14227
2025-12-05 10:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2025-12-05 10:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd9d12d-8e10-5765-89c5-b64d6df63883 with scrape type 2
2025-12-05 10:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dd9d12d-8e10-5765-89c5-b64d6df63883 with scrape type 2
2025-12-05 10:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dd9d12d-8e10-5765-89c5-b64d6df63883, identifier: KK64864
2025-12-05 10:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e with identifier: GB75182
2025-12-05 10:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e with identifier: GB75182
2025-12-05 10:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175030 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175030
2025-12-05 10:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e spider: auto1.it
2025-12-05 10:04:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 16ea6ae5-b4c4-5eca-aff7-0471fbd2952e due to rule: high_mileage_for_country.json, error: 175030 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175030
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-06T16:30:09Z',
 'fuel_type': 'diesel',
 'id': '16ea6ae5-b4c4-5eca-aff7-0471fbd2952e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB75182',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 175030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2017}
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB75182%27 HTTP/1.1" 200 None
2025-12-05 10:04:06 [auto1.it] INFO: Saving data for GB75182: {'auction_closing_time': 1765038609.0, 'created_time': 1763669060.257019, 'last_price_update_time': 1764929046.321139}
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB75182') HTTP/1.1" 204 0
2025-12-05 10:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89779d0f-377a-5b43-8768-cf79b1daf1db with identifier: DF14227
2025-12-05 10:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89779d0f-377a-5b43-8768-cf79b1daf1db with identifier: DF14227
2025-12-05 10:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89779d0f-377a-5b43-8768-cf79b1daf1db with identifier: DF14227 to the API
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF14227>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-06T16:25:42Z',
 'fuel_type': 'diesel',
 'id': '89779d0f-377a-5b43-8768-cf79b1daf1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF14227',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 82866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF14227%27 HTTP/1.1" 200 None
2025-12-05 10:04:06 [auto1.it] INFO: Saving data for DF14227: {'auction_closing_time': 1765038342.0, 'created_time': 1763755321.254505, 'last_price_update_time': 1764929046.72764}
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF14227') HTTP/1.1" 204 0
2025-12-05 10:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2025-12-05 10:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864
2025-12-05 10:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dd9d12d-8e10-5765-89c5-b64d6df63883 with identifier: KK64864 to the API
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK64864>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 231,
 'expiration_date': '2025-12-05T16:07:57Z',
 'fuel_type': 'petrol',
 'id': '5dd9d12d-8e10-5765-89c5-b64d6df63883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK64864',
 'listing': 'auction',
 'location': 'IT, Marino',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 39769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI John Cooper Works Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2023}
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK64864%27 HTTP/1.1" 200 None
2025-12-05 10:04:07 [auto1.it] INFO: Saving data for KK64864: {'auction_closing_time': 1764950877.0, 'created_time': 1764756192.638763, 'last_price_update_time': 1764929047.097246}
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK64864') HTTP/1.1" 204 0
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY37830> (referer: https://www.auto1.com/v1/car-details-view/GY37830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8174648-0b21-5483-a64a-bf7da88c3695 with identifier: GY37830
2025-12-05 10:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8174648-0b21-5483-a64a-bf7da88c3695 with scrape type 2
2025-12-05 10:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8174648-0b21-5483-a64a-bf7da88c3695 with scrape type 2
2025-12-05 10:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8174648-0b21-5483-a64a-bf7da88c3695, identifier: GY37830
2025-12-05 10:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8174648-0b21-5483-a64a-bf7da88c3695 with identifier: GY37830
2025-12-05 10:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8174648-0b21-5483-a64a-bf7da88c3695 with identifier: GY37830
2025-12-05 10:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175939 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175939
2025-12-05 10:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e8174648-0b21-5483-a64a-bf7da88c3695 spider: auto1.it
2025-12-05 10:04:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e8174648-0b21-5483-a64a-bf7da88c3695 due to rule: high_mileage_for_country.json, error: 175939 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175939
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:45:56Z',
 'fuel_type': 'diesel',
 'id': 'e8174648-0b21-5483-a64a-bf7da88c3695',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY37830',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 175939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY37830%27 HTTP/1.1" 200 None
2025-12-05 10:04:07 [auto1.it] INFO: Saving data for GY37830: {'auction_closing_time': 1764953156.0, 'created_time': 1764360569.00726, 'last_price_update_time': 1764929047.592608}
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY37830') HTTP/1.1" 204 0
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR12056/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ46302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE86090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX96026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW26134> (referer: https://www.auto1.com/v1/car-details-view/KW26134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX24318> (referer: https://www.auto1.com/v1/car-details-view/VX24318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC61751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 with identifier: KW26134
2025-12-05 10:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 with scrape type 2
2025-12-05 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 with scrape type 2
2025-12-05 10:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9, identifier: KW26134
2025-12-05 10:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 with identifier: KW26134
2025-12-05 10:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 with identifier: KW26134
2025-12-05 10:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153752 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153752
2025-12-05 10:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 spider: auto1.it
2025-12-05 10:04:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4cc1d5cd-cbbe-5440-b6cf-659f4e589be9 due to rule: high_mileage_for_country.json, error: 153752 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153752
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:58:56Z',
 'fuel_type': 'diesel',
 'id': '4cc1d5cd-cbbe-5440-b6cf-659f4e589be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW26134',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 153752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2019}
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW26134%27 HTTP/1.1" 200 None
2025-12-05 10:04:08 [auto1.it] INFO: Saving data for KW26134: {'auction_closing_time': 1764953936.0, 'created_time': 1763546452.28181, 'last_price_update_time': 1764929048.372973}
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW26134') HTTP/1.1" 204 0
2025-12-05 10:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b2270b-98d2-5b31-bd86-e124db646164 with identifier: VX24318
2025-12-05 10:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b2270b-98d2-5b31-bd86-e124db646164 with scrape type 2
2025-12-05 10:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b2270b-98d2-5b31-bd86-e124db646164 with scrape type 2
2025-12-05 10:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96b2270b-98d2-5b31-bd86-e124db646164, identifier: VX24318
2025-12-05 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF08387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96b2270b-98d2-5b31-bd86-e124db646164 with identifier: VX24318
2025-12-05 10:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96b2270b-98d2-5b31-bd86-e124db646164 with identifier: VX24318
2025-12-05 10:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96b2270b-98d2-5b31-bd86-e124db646164 with identifier: VX24318 to the API
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX24318>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-05T16:21:07Z',
 'fuel_type': 'petrol',
 'id': '96b2270b-98d2-5b31-bd86-e124db646164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX24318',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 48100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.0 Mild-Hybrid Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2021}
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX24318%27 HTTP/1.1" 200 None
2025-12-05 10:04:08 [auto1.it] INFO: Saving data for VX24318: {'auction_closing_time': 1764951667.0, 'created_time': 1764756206.677352, 'last_price_update_time': 1764929048.85618}
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX24318') HTTP/1.1" 204 0
2025-12-05 10:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF45221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK30778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF33342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:09 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: FF86857
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for FF86857: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: VU49285
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU49285%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for VU49285: 2
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: LC75802
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC75802%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for LC75802: 2
2025-12-05 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW68051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: WM98740
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM98740%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for WM98740: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: HF23976
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF23976%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for HF23976: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: JR29785
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR29785%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for JR29785: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: VL50172
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL50172%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for VL50172: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: KB87323
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB87323%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for KB87323: 2
2025-12-05 10:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: PM20495
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20495%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for PM20495: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: YE80036
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE80036%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for YE80036: 2
2025-12-05 10:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC62935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: JT47027
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT47027%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for JT47027: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: GA11350
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA11350%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for GA11350: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: BR83425
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR83425%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for BR83425: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: TN49612
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN49612%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for TN49612: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: WP74262
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP74262%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for WP74262: 2
2025-12-05 10:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: NE58179
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE58179%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for NE58179: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: ZC07011
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC07011%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for ZC07011: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: YB62533
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB62533%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for YB62533: 2
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: AM19633
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM19633%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for AM19633: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: RT80435
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT80435%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for RT80435: 2
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: ZE44848
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE44848%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for ZE44848: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: VU47958
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU47958%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for VU47958: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: ZP66034
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66034%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for ZP66034: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: TF80780
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF80780%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for TF80780: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: JS42412
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS42412%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for JS42412: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: RX31393
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for RX31393: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: XC87400
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC87400%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for XC87400: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: YN88087
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN88087%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for YN88087: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: WA30602
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for WA30602: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: JM64037
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM64037%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for JM64037: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: LN05893
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN05893%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for LN05893: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: SB13925
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for SB13925: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: RT66786
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT66786%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for RT66786: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: DF15601
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF15601%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for DF15601: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: WB04054
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB04054%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for WB04054: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: LL02931
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL02931%27 HTTP/1.1" 200 None
2025-12-05 10:04:09 [auto1.it] INFO: Scrape type for LL02931: 0
2025-12-05 10:04:09 [auto1.it] INFO: Found listing with ID: FJ98323
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ98323%27 HTTP/1.1" 200 None
2025-12-05 10:04:10 [auto1.it] INFO: Scrape type for FJ98323: 0
2025-12-05 10:04:10 [auto1.it] INFO: Found listing with ID: SS33960
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS33960%27 HTTP/1.1" 200 None
2025-12-05 10:04:10 [auto1.it] INFO: Scrape type for SS33960: 0
2025-12-05 10:04:10 [auto1.it] INFO: Found listing with ID: BS07876
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS07876%27 HTTP/1.1" 200 None
2025-12-05 10:04:10 [auto1.it] INFO: Scrape type for BS07876: 0
2025-12-05 10:04:10 [auto1.it] INFO: Found listing with ID: PV10123
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV10123%27 HTTP/1.1" 200 None
2025-12-05 10:04:10 [auto1.it] INFO: Scrape type for PV10123: 0
2025-12-05 10:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC12313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB32763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL82324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY90448/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR12056> (referer: https://www.auto1.com/v1/car-details-view/BR12056/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af036154-1e50-579f-b6ea-8dfb8ae0a077 with identifier: BR12056
2025-12-05 10:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af036154-1e50-579f-b6ea-8dfb8ae0a077 with scrape type 2
2025-12-05 10:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af036154-1e50-579f-b6ea-8dfb8ae0a077 with scrape type 2
2025-12-05 10:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af036154-1e50-579f-b6ea-8dfb8ae0a077, identifier: BR12056
2025-12-05 10:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af036154-1e50-579f-b6ea-8dfb8ae0a077 with identifier: BR12056
2025-12-05 10:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af036154-1e50-579f-b6ea-8dfb8ae0a077 with identifier: BR12056
2025-12-05 10:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati ghibli 3.0 v6 twinturbo s q4', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'ghibli', 'transmission': 'automatic', 'odometer': 55415, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/br12056', 'expiration_date': '2025-12-05t16:15:06z', 'origin_country_code': 'it', 'trim': 's q4', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 410, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, rocca di papa', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6b', 'c_o_2_emission_value': 226, 'id': 'af036154-1e50-579f-b6ea-8dfb8ae0a077', 'current_year_diff': 8, 'age_in_months': 106, 'make_model': 'maserati ghibli', 'sanitized_make': 'maserati', 'odometer_in_km': 55415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 226,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 4,
     'emission_standard': 'euro 6b',
     'engine': '3.0l',
     'engine_horse_power': 410,
     'expiration_date': '2025-12-05t16:15:06z',
     'fuel_type': 'petrol',
     'id': 'af036154-1e50-579f-b6ea-8dfb8ae0a077',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/br12056',
     'listing': 'auction',
     'location': 'it, rocca di papa',
     'make': 'maserati',
     'make_model': 'maserati ghibli',
     'model': 'ghibli',
     'odometer': 55415,
     'odometer_in_km': 55415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-15',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati ghibli 3.0 v6 twinturbo s q4',
     'transmission': 'automatic',
     'trim': 's q4',
     'year': 2017}
2025-12-05 10:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: af036154-1e50-579f-b6ea-8dfb8ae0a077 spider: auto1.it
2025-12-05 10:04:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: af036154-1e50-579f-b6ea-8dfb8ae0a077 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati ghibli 3.0 v6 twinturbo s q4', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'ghibli', 'transmission': 'automatic', 'odometer': 55415, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/br12056', 'expiration_date': '2025-12-05t16:15:06z', 'origin_country_code': 'it', 'trim': 's q4', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 410, 'doors_number': 4, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, rocca di papa', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6b', 'c_o_2_emission_value': 226, 'id': 'af036154-1e50-579f-b6ea-8dfb8ae0a077', 'current_year_diff': 8, 'age_in_months': 106, 'make_model': 'maserati ghibli', 'sanitized_make': 'maserati', 'odometer_in_km': 55415}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 106,
     'auction_title': '',
     'c_o_2_emission_value': 226,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 4,
     'emission_standard': 'euro 6b',
     'engine': '3.0l',
     'engine_horse_power': 410,
     'expiration_date': '2025-12-05t16:15:06z',
     'fuel_type': 'petrol',
     'id': 'af036154-1e50-579f-b6ea-8dfb8ae0a077',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/br12056',
     'listing': 'auction',
     'location': 'it, rocca di papa',
     'make': 'maserati',
     'make_model': 'maserati ghibli',
     'model': 'ghibli',
     'odometer': 55415,
     'odometer_in_km': 55415,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-15',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati ghibli 3.0 v6 twinturbo s q4',
     'transmission': 'automatic',
     'trim': 's q4',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 226,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 410,
 'expiration_date': '2025-12-05T16:15:06Z',
 'fuel_type': 'petrol',
 'id': 'af036154-1e50-579f-b6ea-8dfb8ae0a077',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR12056',
 'listing': 'auction',
 'location': 'IT, Rocca di Papa',
 'make': 'Maserati',
 'model': 'Ghibli',
 'odometer': 55415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Ghibli 3.0 V6 TwinTurbo S Q4',
 'transmission': 'automatic',
 'trim': 'S Q4',
 'year': 2017}
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR12056%27 HTTP/1.1" 200 None
2025-12-05 10:04:10 [auto1.it] INFO: Saving data for BR12056: {'auction_closing_time': 1764951306.0, 'created_time': 1763064303.176706, 'last_price_update_time': 1764929050.965537}
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR12056') HTTP/1.1" 204 0
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU74910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT64449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE82522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX96026> (referer: https://www.auto1.com/v1/car-details-view/RX96026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE86090> (referer: https://www.auto1.com/v1/car-details-view/NE86090/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 with identifier: RX96026
2025-12-05 10:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 with scrape type 2
2025-12-05 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 with scrape type 2
2025-12-05 10:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97, identifier: RX96026
2025-12-05 10:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 with identifier: RX96026
2025-12-05 10:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 with identifier: RX96026
2025-12-05 10:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141855 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141855
2025-12-05 10:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 spider: auto1.it
2025-12-05 10:04:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a0e0d6e2-392d-50f2-aa23-0ca9e3964c97 due to rule: high_mileage_for_make.json, error: 141855 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    141855
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-05T16:38:04Z',
 'fuel_type': 'diesel',
 'id': 'a0e0d6e2-392d-50f2-aa23-0ca9e3964c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX96026',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 141855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
 'transmission': 'automatic',
 'trim': 'Executive Q4',
 'year': 2017}
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX96026%27 HTTP/1.1" 200 None
2025-12-05 10:04:11 [auto1.it] INFO: Saving data for RX96026: {'auction_closing_time': 1764952684.0, 'created_time': 1764756067.936857, 'last_price_update_time': 1764929051.528337}
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX96026') HTTP/1.1" 204 0
2025-12-05 10:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC61751> (referer: https://www.auto1.com/v1/car-details-view/BC61751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1341c54-196a-5cd3-a459-555c9a91829d with identifier: NE86090
2025-12-05 10:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1341c54-196a-5cd3-a459-555c9a91829d with scrape type 2
2025-12-05 10:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1341c54-196a-5cd3-a459-555c9a91829d with scrape type 2
2025-12-05 10:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1341c54-196a-5cd3-a459-555c9a91829d, identifier: NE86090
2025-12-05 10:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1341c54-196a-5cd3-a459-555c9a91829d with identifier: NE86090
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2025-12-05 10:04:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1341c54-196a-5cd3-a459-555c9a91829d with identifier: NE86090
2025-12-05 10:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1341c54-196a-5cd3-a459-555c9a91829d with identifier: NE86090 to the API
2025-12-05 10:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE86090>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-05T16:45:05Z',
 'fuel_type': 'petrol',
 'id': 'c1341c54-196a-5cd3-a459-555c9a91829d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE86090',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 102479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE86090%27 HTTP/1.1" 200 None
2025-12-05 10:04:12 [auto1.it] INFO: Saving data for NE86090: {'auction_closing_time': 1764953105.0, 'created_time': 1764756158.402534, 'last_price_update_time': 1764929052.598314}
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE86090') HTTP/1.1" 204 0
2025-12-05 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE80036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ46302> (referer: https://www.auto1.com/v1/car-details-view/VJ46302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2025-12-05 10:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d539d2ac-85e8-5d2d-860d-67ba5245b881 with scrape type 2
2025-12-05 10:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d539d2ac-85e8-5d2d-860d-67ba5245b881 with scrape type 2
2025-12-05 10:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d539d2ac-85e8-5d2d-860d-67ba5245b881, identifier: BC61751
2025-12-05 10:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2025-12-05 10:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2025-12-05 10:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751 to the API
2025-12-05 10:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC61751>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:49:25Z',
 'fuel_type': 'diesel',
 'id': 'd539d2ac-85e8-5d2d-860d-67ba5245b881',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC61751',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 136311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2019}
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2025-12-05 10:04:13 [auto1.it] INFO: Saving data for BC61751: {'auction_closing_time': 1764953365.0, 'created_time': 1763028084.389497, 'last_price_update_time': 1764929053.54558}
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC61751') HTTP/1.1" 204 0
2025-12-05 10:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with identifier: VJ46302
2025-12-05 10:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with scrape type 2
2025-12-05 10:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with scrape type 2
2025-12-05 10:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef, identifier: VJ46302
2025-12-05 10:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with identifier: VJ46302
2025-12-05 10:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with identifier: VJ46302
2025-12-05 10:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8cfa9d47-b666-554f-a44d-cb0eb7bd30ef with identifier: VJ46302 to the API
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ46302>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 162,
 'expiration_date': '2025-12-05T16:39:43Z',
 'fuel_type': 'petrol',
 'id': '8cfa9d47-b666-554f-a44d-cb0eb7bd30ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ46302',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'MG',
 'model': 'HS',
 'odometer': 79040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG HS 1.5 Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2023}
2025-12-05 10:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ46302%27 HTTP/1.1" 200 None
2025-12-05 10:04:14 [auto1.it] INFO: Saving data for VJ46302: {'auction_closing_time': 1764952783.0, 'created_time': 1763582609.352569, 'last_price_update_time': 1764929054.002533}
2025-12-05 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ46302') HTTP/1.1" 204 0
2025-12-05 10:04:17 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 107 pages/min), scraped 86 items (at 35 items/min)
2025-12-05 10:05:17 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 0 pages/min), scraped 86 items (at 0 items/min)
2025-12-05 10:06:17 [scrapy.extensions.logstats] INFO: Crawled 263 pages (at 0 pages/min), scraped 86 items (at 0 items/min)
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.166(s), this was the 1st time calling it.
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.353177072234245 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.738(s), this was the 1st time calling it.
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.59357734144373 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.214(s), this was the 1st time calling it.
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.252072950277034 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.171(s), this was the 1st time calling it.
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.499557123069814 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.217(s), this was the 1st time calling it.
2025-12-05 10:06:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.180281912089907 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.713(s), this was the 1st time calling it.
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.849545581855736 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.714(s), this was the 1st time calling it.
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.346828148221341 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.767(s), this was the 1st time calling it.
2025-12-05 10:06:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.176047737179289 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC62935> (referer: https://www.auto1.com/v1/car-details-view/KC62935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with identifier: KC62935
2025-12-05 10:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with scrape type 2
2025-12-05 10:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with scrape type 2
2025-12-05 10:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bee2ea4-f24d-5a1b-b572-ecffd7776e45, identifier: KC62935
2025-12-05 10:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with identifier: KC62935
2025-12-05 10:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with identifier: KC62935
2025-12-05 10:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bee2ea4-f24d-5a1b-b572-ecffd7776e45 with identifier: KC62935 to the API
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC62935>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:25:35Z',
 'fuel_type': 'petrol',
 'id': '2bee2ea4-f24d-5a1b-b572-ecffd7776e45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC62935',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 33046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Ultimate',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2023}
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC62935%27 HTTP/1.1" 200 None
2025-12-05 10:06:27 [auto1.it] INFO: Saving data for KC62935: {'auction_closing_time': 1765038335.0, 'created_time': 1761595706.763823, 'last_price_update_time': 1764929187.359069}
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC62935') HTTP/1.1" 204 0
2025-12-05 10:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW68051> (referer: https://www.auto1.com/v1/car-details-view/CW68051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3772dc6b-bec6-5acb-9a4a-0be131070351 with identifier: CW68051
2025-12-05 10:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3772dc6b-bec6-5acb-9a4a-0be131070351 with scrape type 2
2025-12-05 10:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3772dc6b-bec6-5acb-9a4a-0be131070351 with scrape type 2
2025-12-05 10:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3772dc6b-bec6-5acb-9a4a-0be131070351, identifier: CW68051
2025-12-05 10:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3772dc6b-bec6-5acb-9a4a-0be131070351 with identifier: CW68051
2025-12-05 10:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3772dc6b-bec6-5acb-9a4a-0be131070351 with identifier: CW68051
2025-12-05 10:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163816 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163816
2025-12-05 10:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3772dc6b-bec6-5acb-9a4a-0be131070351 spider: auto1.it
2025-12-05 10:06:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 3772dc6b-bec6-5acb-9a4a-0be131070351 due to rule: high_mileage_for_country.json, error: 163816 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163816
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:06:12Z',
 'fuel_type': 'diesel',
 'id': '3772dc6b-bec6-5acb-9a4a-0be131070351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW68051',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 163816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2017}
2025-12-05 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW68051%27 HTTP/1.1" 200 None
2025-12-05 10:06:28 [auto1.it] INFO: Saving data for CW68051: {'auction_closing_time': 1765037172.0, 'created_time': 1764100841.060778, 'last_price_update_time': 1764929188.707199}
2025-12-05 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW68051') HTTP/1.1" 204 0
2025-12-05 10:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB32763> (referer: https://www.auto1.com/v1/car-details-view/CB32763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91eef082-fe68-518e-811d-587505a4925b with identifier: CB32763
2025-12-05 10:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91eef082-fe68-518e-811d-587505a4925b with scrape type 2
2025-12-05 10:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91eef082-fe68-518e-811d-587505a4925b with scrape type 2
2025-12-05 10:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91eef082-fe68-518e-811d-587505a4925b, identifier: CB32763
2025-12-05 10:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91eef082-fe68-518e-811d-587505a4925b with identifier: CB32763
2025-12-05 10:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91eef082-fe68-518e-811d-587505a4925b with identifier: CB32763
2025-12-05 10:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91eef082-fe68-518e-811d-587505a4925b with identifier: CB32763 to the API
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB32763>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-06T16:20:04Z',
 'fuel_type': 'petrol',
 'id': '91eef082-fe68-518e-811d-587505a4925b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB32763',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 77471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2017}
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB32763%27 HTTP/1.1" 200 None
2025-12-05 10:06:30 [auto1.it] INFO: Saving data for CB32763: {'auction_closing_time': 1765038004.0, 'created_time': 1764187527.511605, 'last_price_update_time': 1764929190.458789}
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB32763') HTTP/1.1" 204 0
2025-12-05 10:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL82324> (referer: https://www.auto1.com/v1/car-details-view/BL82324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 175c1569-a94f-50d2-9715-07a5a7e03c85 with identifier: BL82324
2025-12-05 10:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 175c1569-a94f-50d2-9715-07a5a7e03c85 with scrape type 2
2025-12-05 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 175c1569-a94f-50d2-9715-07a5a7e03c85 with scrape type 2
2025-12-05 10:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 175c1569-a94f-50d2-9715-07a5a7e03c85, identifier: BL82324
2025-12-05 10:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 175c1569-a94f-50d2-9715-07a5a7e03c85 with identifier: BL82324
2025-12-05 10:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 175c1569-a94f-50d2-9715-07a5a7e03c85 with identifier: BL82324
2025-12-05 10:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 175c1569-a94f-50d2-9715-07a5a7e03c85 with identifier: BL82324 to the API
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL82324>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-06T16:19:38Z',
 'fuel_type': 'diesel',
 'id': '175c1569-a94f-50d2-9715-07a5a7e03c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL82324',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 118362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive AWD',
 'transmission': 'automatic',
 'trim': 'Exclusive AWD',
 'year': 2020}
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL82324%27 HTTP/1.1" 200 None
2025-12-05 10:06:31 [auto1.it] INFO: Saving data for BL82324: {'auction_closing_time': 1765037978.0, 'created_time': 1764100931.014606, 'last_price_update_time': 1764929191.734098}
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL82324') HTTP/1.1" 204 0
2025-12-05 10:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT80435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB62533/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC12313> (referer: https://www.auto1.com/v1/car-details-view/ZC12313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF45221> (referer: https://www.auto1.com/v1/car-details-view/NF45221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53f0cb4-594a-5b07-807f-691e718d4831 with identifier: ZC12313
2025-12-05 10:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53f0cb4-594a-5b07-807f-691e718d4831 with scrape type 2
2025-12-05 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53f0cb4-594a-5b07-807f-691e718d4831 with scrape type 2
2025-12-05 10:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a53f0cb4-594a-5b07-807f-691e718d4831, identifier: ZC12313
2025-12-05 10:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2025-12-05 10:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with scrape type 2
2025-12-05 10:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with scrape type 2
2025-12-05 10:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8, identifier: NF45221
2025-12-05 10:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a53f0cb4-594a-5b07-807f-691e718d4831 with identifier: ZC12313
2025-12-05 10:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a53f0cb4-594a-5b07-807f-691e718d4831 with identifier: ZC12313
2025-12-05 10:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a53f0cb4-594a-5b07-807f-691e718d4831 with identifier: ZC12313 to the API
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC12313>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2025-12-06T16:53:37Z',
 'fuel_type': 'petrol',
 'id': 'a53f0cb4-594a-5b07-807f-691e718d4831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC12313',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 83848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC12313%27 HTTP/1.1" 200 None
2025-12-05 10:06:32 [auto1.it] INFO: Saving data for ZC12313: {'auction_closing_time': 1765040017.0, 'created_time': 1764619460.468621, 'last_price_update_time': 1764929192.37682}
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC12313') HTTP/1.1" 204 0
2025-12-05 10:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2025-12-05 10:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2025-12-05 10:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221 to the API
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF45221>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2025-12-05T16:33:32Z',
 'fuel_type': 'diesel',
 'id': '1c76bfc3-aa3f-5a5b-8de3-2981365773c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF45221',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 135770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Business Line',
 'transmission': 'automatic',
 'trim': 'Business Line',
 'year': 2019}
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2025-12-05 10:06:32 [auto1.it] INFO: Saving data for NF45221: {'auction_closing_time': 1764952412.0, 'created_time': 1763107251.310604, 'last_price_update_time': 1764929192.741126}
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF45221') HTTP/1.1" 204 0
2025-12-05 10:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB87323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP74262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE82522> (referer: https://www.auto1.com/v1/car-details-view/CE82522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f291a8-2097-5560-b62c-8ab4147feaf4 with identifier: CE82522
2025-12-05 10:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f291a8-2097-5560-b62c-8ab4147feaf4 with scrape type 1
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a9f291a8-2097-5560-b62c-8ab4147feaf4
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_68b62bc564109a1778791ca475ff102f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_68b62bc564109a1778791ca475ff102f.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_a0e2e65b340661094baedd8d58b03e79.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_a0e2e65b340661094baedd8d58b03e79.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_9131dc33a5ceaa10ae6b172ea7cb9c5a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_9131dc33a5ceaa10ae6b172ea7cb9c5a.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_01cd83b75e834c6f61866d72da271701.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_01cd83b75e834c6f61866d72da271701.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_30c69f5aca25538ad63809bdf572066d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_30c69f5aca25538ad63809bdf572066d.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_b9f3812e1b50ef51719807b35a910943.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_b9f3812e1b50ef51719807b35a910943.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_385fc59250a2536ef4a4d906fda1d20d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_385fc59250a2536ef4a4d906fda1d20d.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_4d996920dcd373352cfd827c04900e70.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_4d996920dcd373352cfd827c04900e70.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_ab5ee9f72c81849cc2e52a5d8c1e0e8c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_ab5ee9f72c81849cc2e52a5d8c1e0e8c.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_5ba6beb29c2831a0b673e7cacbeb4368.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_5ba6beb29c2831a0b673e7cacbeb4368.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_f19661ac0c665846b39b51847464971e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_f19661ac0c665846b39b51847464971e.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_39ed173832fdb27581881c2cbee86a57.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_39ed173832fdb27581881c2cbee86a57.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_97a38a9afce6ed2f8ce34f8b7b3c0ef7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_97a38a9afce6ed2f8ce34f8b7b3c0ef7.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_c0f1b2db67adb13e4755130029d3b7cf.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_c0f1b2db67adb13e4755130029d3b7cf.jpg already downloaded
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F70%252F07702fa5b3a2dcd2d067f1e398a565ef%252Fpa%252FCE82522_daa7fdaf7058599a67811860c321aa96.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_daa7fdaf7058599a67811860c321aa96.jpg already downloaded
2025-12-05 10:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9f291a8-2097-5560-b62c-8ab4147feaf4, identifier: CE82522
2025-12-05 10:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9f291a8-2097-5560-b62c-8ab4147feaf4 with identifier: CE82522
2025-12-05 10:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9f291a8-2097-5560-b62c-8ab4147feaf4 with identifier: CE82522
2025-12-05 10:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9f291a8-2097-5560-b62c-8ab4147feaf4 with identifier: CE82522 to the API
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE82522>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-06T16:50:26Z',
 'fuel_type': 'petrol',
 'id': 'a9f291a8-2097-5560-b62c-8ab4147feaf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE82522',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 10267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_68b62bc564109a1778791ca475ff102f.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_a0e2e65b340661094baedd8d58b03e79.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_9131dc33a5ceaa10ae6b172ea7cb9c5a.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_01cd83b75e834c6f61866d72da271701.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_30c69f5aca25538ad63809bdf572066d.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_b9f3812e1b50ef51719807b35a910943.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_385fc59250a2536ef4a4d906fda1d20d.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_4d996920dcd373352cfd827c04900e70.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_ab5ee9f72c81849cc2e52a5d8c1e0e8c.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_5ba6beb29c2831a0b673e7cacbeb4368.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_f19661ac0c665846b39b51847464971e.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_39ed173832fdb27581881c2cbee86a57.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_97a38a9afce6ed2f8ce34f8b7b3c0ef7.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_c0f1b2db67adb13e4755130029d3b7cf.jpg',
                'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_daa7fdaf7058599a67811860c321aa96.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2947945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_68b62bc564109a1778791ca475ff102f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_a0e2e65b340661094baedd8d58b03e79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794150,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_9131dc33a5ceaa10ae6b172ea7cb9c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2642920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_01cd83b75e834c6f61866d72da271701.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_30c69f5aca25538ad63809bdf572066d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_b9f3812e1b50ef51719807b35a910943.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_385fc59250a2536ef4a4d906fda1d20d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_4d996920dcd373352cfd827c04900e70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2706874,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_ab5ee9f72c81849cc2e52a5d8c1e0e8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_5ba6beb29c2831a0b673e7cacbeb4368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_f19661ac0c665846b39b51847464971e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_39ed173832fdb27581881c2cbee86a57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_97a38a9afce6ed2f8ce34f8b7b3c0ef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2230546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_c0f1b2db67adb13e4755130029d3b7cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9f291a8-2097-5560-b62c-8ab4147feaf4/a9f291a8-2097-5560-b62c-8ab4147feaf4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/70/07702fa5b3a2dcd2d067f1e398a565ef/pa/CE82522_daa7fdaf7058599a67811860c321aa96.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE82522%27 HTTP/1.1" 200 None
2025-12-05 10:06:34 [auto1.it] INFO: Saving data for CE82522: {'created_time': 1764929194.836861, 'last_price_update_time': 1764929194.836871, 'auction_closing_time': 1765039826.0}
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE82522') HTTP/1.1" 204 0
2025-12-05 10:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT64449> (referer: https://www.auto1.com/v1/car-details-view/KT64449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with identifier: KT64449
2025-12-05 10:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with scrape type 2
2025-12-05 10:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with scrape type 2
2025-12-05 10:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58576b4c-8912-583d-8aaf-cb422f1ee0c4, identifier: KT64449
2025-12-05 10:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with identifier: KT64449
2025-12-05 10:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with identifier: KT64449
2025-12-05 10:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58576b4c-8912-583d-8aaf-cb422f1ee0c4 with identifier: KT64449 to the API
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT64449>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-06T16:22:33Z',
 'fuel_type': 'diesel',
 'id': '58576b4c-8912-583d-8aaf-cb422f1ee0c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT64449',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 78458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64449%27 HTTP/1.1" 200 None
2025-12-05 10:06:35 [auto1.it] INFO: Saving data for KT64449: {'auction_closing_time': 1765038153.0, 'created_time': 1763755669.919213, 'last_price_update_time': 1764929195.365539}
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT64449') HTTP/1.1" 204 0
2025-12-05 10:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK30778> (referer: https://www.auto1.com/v1/car-details-view/CK30778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98a12d35-f644-5fb3-ad47-756d0d68db18 with identifier: CK30778
2025-12-05 10:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98a12d35-f644-5fb3-ad47-756d0d68db18 with scrape type 2
2025-12-05 10:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98a12d35-f644-5fb3-ad47-756d0d68db18 with scrape type 2
2025-12-05 10:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98a12d35-f644-5fb3-ad47-756d0d68db18, identifier: CK30778
2025-12-05 10:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98a12d35-f644-5fb3-ad47-756d0d68db18 with identifier: CK30778
2025-12-05 10:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98a12d35-f644-5fb3-ad47-756d0d68db18 with identifier: CK30778
2025-12-05 10:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98a12d35-f644-5fb3-ad47-756d0d68db18 with identifier: CK30778 to the API
2025-12-05 10:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK30778>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2025-12-05T16:55:59Z',
 'fuel_type': 'diesel',
 'id': '98a12d35-f644-5fb3-ad47-756d0d68db18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK30778',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 95580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2017}
2025-12-05 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK30778%27 HTTP/1.1" 200 None
2025-12-05 10:06:37 [auto1.it] INFO: Saving data for CK30778: {'auction_closing_time': 1764953759.0, 'created_time': 1762286815.096174, 'last_price_update_time': 1764929197.363037}
2025-12-05 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK30778') HTTP/1.1" 204 0
2025-12-05 10:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE80036> (referer: https://www.auto1.com/v1/car-details-view/YE80036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with identifier: YE80036
2025-12-05 10:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with scrape type 2
2025-12-05 10:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with scrape type 2
2025-12-05 10:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 566fc1eb-72aa-5a8a-812e-4228dd2587a9, identifier: YE80036
2025-12-05 10:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with identifier: YE80036
2025-12-05 10:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with identifier: YE80036
2025-12-05 10:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 566fc1eb-72aa-5a8a-812e-4228dd2587a9 with identifier: YE80036 to the API
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE80036>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2025-12-05T16:02:05Z',
 'fuel_type': 'diesel',
 'id': '566fc1eb-72aa-5a8a-812e-4228dd2587a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE80036',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 143434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 114d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE80036%27 HTTP/1.1" 200 None
2025-12-05 10:06:40 [auto1.it] INFO: Saving data for YE80036: {'auction_closing_time': 1764950525.0, 'created_time': 1764756139.61317, 'last_price_update_time': 1764929200.341195}
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE80036') HTTP/1.1" 204 0
2025-12-05 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD37849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC75802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:42 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: PV10123
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV10123%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for PV10123: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: BB86580
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB86580%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for BB86580: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: LJ31418
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ31418%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for LJ31418: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: HN76486
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN76486%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for HN76486: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: YY50818
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY50818%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for YY50818: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: UB43955
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB43955%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for UB43955: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: BA17925
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA17925%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for BA17925: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: LJ59063
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ59063%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for LJ59063: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: AN42537
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN42537%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for AN42537: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: MB68559
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB68559%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for MB68559: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: MT35783
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT35783%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for MT35783: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: FN77058
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for FN77058: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: XK22503
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK22503%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for XK22503: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: MZ93875
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ93875%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for MZ93875: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: YY81592
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY81592%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for YY81592: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: AB72839
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB72839%27 HTTP/1.1" 200 None
2025-12-05 10:06:42 [auto1.it] INFO: Scrape type for AB72839: 0
2025-12-05 10:06:42 [auto1.it] INFO: Found listing with ID: XD09667
2025-12-05 10:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD09667%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for XD09667: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: NY40459
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY40459%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for NY40459: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: UX72610
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX72610%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for UX72610: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: GE32816
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE32816%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for GE32816: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: FM62222
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM62222%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for FM62222: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: TH52637
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH52637%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for TH52637: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: SE19041
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE19041%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for SE19041: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: ML11000
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML11000%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for ML11000: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: LG38925
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG38925%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for LG38925: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: CB71974
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB71974%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for CB71974: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: AA23361
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA23361%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for AA23361: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: GZ38175
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ38175%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for GZ38175: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: RK87672
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK87672%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for RK87672: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: LU85164
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU85164%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for LU85164: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: MV61380
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV61380%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for MV61380: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: WD98953
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for WD98953: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: HX83454
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX83454%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for HX83454: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: KN71804
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN71804%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for KN71804: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: CV66945
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV66945%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for CV66945: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: LV31486
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV31486%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for LV31486: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: LG49577
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG49577%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for LG49577: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: DW69634
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW69634%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for DW69634: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: EW36675
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for EW36675: 0
2025-12-05 10:06:43 [auto1.it] INFO: Found listing with ID: UJ32483
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ32483%27 HTTP/1.1" 200 None
2025-12-05 10:06:43 [auto1.it] INFO: Scrape type for UJ32483: 0
2025-12-05 10:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX65546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU74910> (referer: https://www.auto1.com/v1/car-details-view/LU74910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e972bc72-c7c6-56f1-835f-3b961ec46c91 with identifier: LU74910
2025-12-05 10:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e972bc72-c7c6-56f1-835f-3b961ec46c91 with scrape type 2
2025-12-05 10:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e972bc72-c7c6-56f1-835f-3b961ec46c91 with scrape type 2
2025-12-05 10:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e972bc72-c7c6-56f1-835f-3b961ec46c91, identifier: LU74910
2025-12-05 10:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e972bc72-c7c6-56f1-835f-3b961ec46c91 with identifier: LU74910
2025-12-05 10:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e972bc72-c7c6-56f1-835f-3b961ec46c91 with identifier: LU74910
2025-12-05 10:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e972bc72-c7c6-56f1-835f-3b961ec46c91 with identifier: LU74910 to the API
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU74910>
{'auction_title': '',
 'c_o_2_emission_value': 79,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 381,
 'expiration_date': '2025-12-06T16:39:47Z',
 'fuel_type': 'hybrid',
 'id': 'e972bc72-c7c6-56f1-835f-3b961ec46c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU74910',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 37024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2021}
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU74910%27 HTTP/1.1" 200 None
2025-12-05 10:06:45 [auto1.it] INFO: Saving data for LU74910: {'auction_closing_time': 1765039187.0, 'created_time': 1764187252.095064, 'last_price_update_time': 1764929205.280097}
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU74910') HTTP/1.1" 204 0
2025-12-05 10:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP74262> (referer: https://www.auto1.com/v1/car-details-view/WP74262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38148aa7-3b74-5045-8d55-326bee109eaa with identifier: WP74262
2025-12-05 10:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38148aa7-3b74-5045-8d55-326bee109eaa with scrape type 2
2025-12-05 10:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38148aa7-3b74-5045-8d55-326bee109eaa with scrape type 2
2025-12-05 10:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38148aa7-3b74-5045-8d55-326bee109eaa, identifier: WP74262
2025-12-05 10:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38148aa7-3b74-5045-8d55-326bee109eaa with identifier: WP74262
2025-12-05 10:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38148aa7-3b74-5045-8d55-326bee109eaa with identifier: WP74262
2025-12-05 10:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38148aa7-3b74-5045-8d55-326bee109eaa with identifier: WP74262 to the API
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP74262>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 249,
 'expiration_date': '2025-12-05T16:42:57Z',
 'fuel_type': 'diesel',
 'id': '38148aa7-3b74-5045-8d55-326bee109eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP74262',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 146818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP74262%27 HTTP/1.1" 200 None
2025-12-05 10:06:47 [auto1.it] INFO: Saving data for WP74262: {'auction_closing_time': 1764952977.0, 'created_time': 1764756057.045071, 'last_price_update_time': 1764929207.378194}
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP74262') HTTP/1.1" 204 0
2025-12-05 10:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF08387> (referer: https://www.auto1.com/v1/car-details-view/KF08387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT80435> (referer: https://www.auto1.com/v1/car-details-view/RT80435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2025-12-05 10:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217a9dbe-02ef-53e4-9b51-10ba9443b045 with scrape type 2
2025-12-05 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217a9dbe-02ef-53e4-9b51-10ba9443b045 with scrape type 2
2025-12-05 10:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 217a9dbe-02ef-53e4-9b51-10ba9443b045, identifier: KF08387
2025-12-05 10:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2025-12-05 10:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2025-12-05 10:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387 to the API
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF08387>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2025-12-05T16:05:53Z',
 'fuel_type': 'diesel',
 'id': '217a9dbe-02ef-53e4-9b51-10ba9443b045',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF08387',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 142961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2019}
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF08387%27 HTTP/1.1" 200 None
2025-12-05 10:06:49 [auto1.it] INFO: Saving data for KF08387: {'auction_closing_time': 1764950753.0, 'created_time': 1764756173.91587, 'last_price_update_time': 1764929209.87427}
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF08387') HTTP/1.1" 204 0
2025-12-05 10:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf6165a-f53e-581e-881c-ad62fbf7f675 with identifier: RT80435
2025-12-05 10:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf6165a-f53e-581e-881c-ad62fbf7f675 with scrape type 2
2025-12-05 10:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf6165a-f53e-581e-881c-ad62fbf7f675 with scrape type 2
2025-12-05 10:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccf6165a-f53e-581e-881c-ad62fbf7f675, identifier: RT80435
2025-12-05 10:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccf6165a-f53e-581e-881c-ad62fbf7f675 with identifier: RT80435
2025-12-05 10:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccf6165a-f53e-581e-881c-ad62fbf7f675 with identifier: RT80435
2025-12-05 10:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccf6165a-f53e-581e-881c-ad62fbf7f675 with identifier: RT80435 to the API
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT80435>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2025-12-05T16:04:09Z',
 'fuel_type': 'petrol',
 'id': 'ccf6165a-f53e-581e-881c-ad62fbf7f675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT80435',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 31340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT80435%27 HTTP/1.1" 200 None
2025-12-05 10:06:50 [auto1.it] INFO: Saving data for RT80435: {'auction_closing_time': 1764950649.0, 'created_time': 1764748861.977921, 'last_price_update_time': 1764929210.659847}
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT80435') HTTP/1.1" 204 0
2025-12-05 10:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH86693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF33342> (referer: https://www.auto1.com/v1/car-details-view/GF33342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e3046cf-0859-5148-ab39-ec78174d25e5 with identifier: GF33342
2025-12-05 10:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e3046cf-0859-5148-ab39-ec78174d25e5 with scrape type 2
2025-12-05 10:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e3046cf-0859-5148-ab39-ec78174d25e5 with scrape type 2
2025-12-05 10:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7e3046cf-0859-5148-ab39-ec78174d25e5, identifier: GF33342
2025-12-05 10:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7e3046cf-0859-5148-ab39-ec78174d25e5 with identifier: GF33342
2025-12-05 10:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7e3046cf-0859-5148-ab39-ec78174d25e5 with identifier: GF33342
2025-12-05 10:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7e3046cf-0859-5148-ab39-ec78174d25e5 with identifier: GF33342 to the API
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF33342>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:57:00Z',
 'fuel_type': 'diesel',
 'id': '7e3046cf-0859-5148-ab39-ec78174d25e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF33342',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 147946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Advance 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance 4Motion BlueMotion',
 'year': 2018}
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF33342%27 HTTP/1.1" 200 None
2025-12-05 10:06:55 [auto1.it] INFO: Saving data for GF33342: {'auction_closing_time': 1764953820.0, 'created_time': 1764014591.913172, 'last_price_update_time': 1764929215.865085}
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GF33342') HTTP/1.1" 204 0
2025-12-05 10:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB62533> (referer: https://www.auto1.com/v1/car-details-view/YB62533/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47080df2-a37e-556a-a682-635739b49f95 with identifier: YB62533
2025-12-05 10:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47080df2-a37e-556a-a682-635739b49f95 with scrape type 2
2025-12-05 10:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47080df2-a37e-556a-a682-635739b49f95 with scrape type 2
2025-12-05 10:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47080df2-a37e-556a-a682-635739b49f95, identifier: YB62533
2025-12-05 10:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47080df2-a37e-556a-a682-635739b49f95 with identifier: YB62533
2025-12-05 10:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47080df2-a37e-556a-a682-635739b49f95 with identifier: YB62533
2025-12-05 10:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47080df2-a37e-556a-a682-635739b49f95 with identifier: YB62533 to the API
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB62533>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-05T16:56:47Z',
 'fuel_type': 'petrol',
 'id': '47080df2-a37e-556a-a682-635739b49f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB62533',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 114119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB62533%27 HTTP/1.1" 200 None
2025-12-05 10:06:59 [auto1.it] INFO: Saving data for YB62533: {'auction_closing_time': 1764953807.0, 'created_time': 1764014969.407467, 'last_price_update_time': 1764929219.917732}
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB62533') HTTP/1.1" 204 0
2025-12-05 10:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU49285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC75802> (referer: https://www.auto1.com/v1/car-details-view/LC75802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f285f401-170a-5919-bea7-2a51dc2a7ffb with identifier: LC75802
2025-12-05 10:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f285f401-170a-5919-bea7-2a51dc2a7ffb with scrape type 2
2025-12-05 10:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f285f401-170a-5919-bea7-2a51dc2a7ffb with scrape type 2
2025-12-05 10:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f285f401-170a-5919-bea7-2a51dc2a7ffb, identifier: LC75802
2025-12-05 10:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f285f401-170a-5919-bea7-2a51dc2a7ffb with identifier: LC75802
2025-12-05 10:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f285f401-170a-5919-bea7-2a51dc2a7ffb with identifier: LC75802
2025-12-05 10:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f285f401-170a-5919-bea7-2a51dc2a7ffb with identifier: LC75802 to the API
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC75802>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:18:31Z',
 'fuel_type': 'diesel',
 'id': 'f285f401-170a-5919-bea7-2a51dc2a7ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC75802',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 142375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC75802%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Saving data for LC75802: {'auction_closing_time': 1764951511.0, 'created_time': 1764014512.059907, 'last_price_update_time': 1764929228.557276}
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC75802') HTTP/1.1" 204 0
2025-12-05 10:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:08 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: AT15385
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT15385%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for AT15385: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: MD91819
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD91819%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for MD91819: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: ZK21872
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK21872%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for ZK21872: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: XM98126
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for XM98126: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: TY94975
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY94975%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for TY94975: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: CG06923
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG06923%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for CG06923: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: HU53329
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU53329%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for HU53329: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: NE95141
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE95141%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for NE95141: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: LG42514
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG42514%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for LG42514: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: MR22813
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR22813%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for MR22813: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: LM12647
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for LM12647: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: TZ60695
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ60695%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for TZ60695: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: XC50328
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50328%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for XC50328: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: ZS31369
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for ZS31369: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: UD92200
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD92200%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for UD92200: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: JB89811
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB89811%27 HTTP/1.1" 200 None
2025-12-05 10:07:08 [auto1.it] INFO: Scrape type for JB89811: 0
2025-12-05 10:07:08 [auto1.it] INFO: Found listing with ID: LG07242
2025-12-05 10:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for LG07242: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: XS04727
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for XS04727: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: EU52479
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU52479%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for EU52479: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: TJ68203
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68203%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for TJ68203: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: KR86350
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR86350%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for KR86350: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: UB06957
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB06957%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for UB06957: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: RK40358
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK40358%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for RK40358: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: AF72034
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF72034%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for AF72034: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: TL62123
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL62123%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for TL62123: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: EN94369
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN94369%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for EN94369: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: TF52868
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF52868%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for TF52868: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: ZF13213
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF13213%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for ZF13213: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: EK82285
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK82285%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for EK82285: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: JX61108
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX61108%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for JX61108: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: DK20818
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK20818%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for DK20818: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: LE73930
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE73930%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for LE73930: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: CP98960
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP98960%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for CP98960: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: GM86600
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86600%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for GM86600: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: TX73310
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX73310%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for TX73310: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: MX11198
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for MX11198: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: MB36009
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB36009%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for MB36009: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: GH09100
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH09100%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for GH09100: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: MD81052
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD81052%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for MD81052: 0
2025-12-05 10:07:09 [auto1.it] INFO: Found listing with ID: TH65791
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH65791%27 HTTP/1.1" 200 None
2025-12-05 10:07:09 [auto1.it] INFO: Scrape type for TH65791: 0
2025-12-05 10:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ38543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX65546> (referer: https://www.auto1.com/v1/car-details-view/BX65546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e39615-22c7-50f7-b3ac-cf83f5319e12 with identifier: BX65546
2025-12-05 10:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e39615-22c7-50f7-b3ac-cf83f5319e12 with scrape type 1
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_244d8f1d924d96e867877dafe4f994d1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_244d8f1d924d96e867877dafe4f994d1.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg not downloaded yet
2025-12-05 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH57663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg not downloaded yet
2025-12-05 10:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_6f642f63657daefd566597d0816c95da.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f642f63657daefd566597d0816c95da.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_0b3af939a7853368008d301fff6b834c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_0b3af939a7853368008d301fff6b834c.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_07ed1e070c74679564de191ca65e4c7e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_07ed1e070c74679564de191ca65e4c7e.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_6f5975c7b0675c396d9a61144f92ccab.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f5975c7b0675c396d9a61144f92ccab.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_42bff4bff8adf5531b1614343935d56a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_42bff4bff8adf5531b1614343935d56a.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_649962053988b5190b7fda321b9383ca.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_649962053988b5190b7fda321b9383ca.jpg not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_1edae1e2615d8d482ad043e62e5a0807.png%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_1edae1e2615d8d482ad043e62e5a0807.png not downloaded yet
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png%27 HTTP/1.1" 200 None
2025-12-05 10:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png not downloaded yet
2025-12-05 10:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef2750>
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg saved to cache
2025-12-05 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH86693> (referer: https://www.auto1.com/v1/car-details-view/NH86693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef4fd0>
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg saved to cache
2025-12-05 10:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f642f63657daefd566597d0816c95da.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_0b3af939a7853368008d301fff6b834c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_649962053988b5190b7fda321b9383ca.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30a7cd0>
2025-12-05 10:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg saved to cache
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with identifier: NH86693
2025-12-05 10:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with scrape type 1
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg not downloaded yet
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_2b5a886eac947090c1db1a0768a5f49e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_2b5a886eac947090c1db1a0768a5f49e.jpg not downloaded yet
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db010cc10>
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_6f642f63657daefd566597d0816c95da.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f642f63657daefd566597d0816c95da.jpg saved to cache
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3453790>
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_0b3af939a7853368008d301fff6b834c.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_0b3af939a7853368008d301fff6b834c.jpg saved to cache
2025-12-05 10:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3346b90>
2025-12-05 10:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_649962053988b5190b7fda321b9383ca.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_649962053988b5190b7fda321b9383ca.jpg saved to cache
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg not downloaded yet
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f5975c7b0675c396d9a61144f92ccab.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg not downloaded yet
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ38543> (referer: https://www.auto1.com/v1/car-details-view/ZZ38543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_26a5301b0d56c10c412235afa92e66ac.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_26a5301b0d56c10c412235afa92e66ac.jpg not downloaded yet
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg not downloaded yet
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_1edae1e2615d8d482ad043e62e5a0807.png> (referer: https://www.auto1.com/)
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_d88d2de112a6e7b869a6a08a64119e06.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d88d2de112a6e7b869a6a08a64119e06.jpg not downloaded yet
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_4126c6cd5e628058850f7f84a49bc701.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_4126c6cd5e628058850f7f84a49bc701.jpg not downloaded yet
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_244d8f1d924d96e867877dafe4f994d1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_21b167afae0241c5e70293db6914a78e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_21b167afae0241c5e70293db6914a78e.jpg not downloaded yet
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30872d0>
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg saved to cache
2025-12-05 10:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34832d0>
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_6f5975c7b0675c396d9a61144f92ccab.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f5975c7b0675c396d9a61144f92ccab.jpg saved to cache
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_c134a19f4868ff6ced7b52d11df06254.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_c134a19f4868ff6ced7b52d11df06254.jpg not downloaded yet
2025-12-05 10:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_26a5301b0d56c10c412235afa92e66ac.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7dacc1a-b131-5d63-9a51-a3ae414778f5 with identifier: ZZ38543
2025-12-05 10:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7dacc1a-b131-5d63-9a51-a3ae414778f5 with scrape type 1
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg not downloaded yet
2025-12-05 10:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_2b5a886eac947090c1db1a0768a5f49e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_42bff4bff8adf5531b1614343935d56a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_7b1679a6dd2452835f7c95d381719ac6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_7b1679a6dd2452835f7c95d381719ac6.jpg not downloaded yet
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_2664a918befefcb2a112ab081ab04d92.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_2664a918befefcb2a112ab081ab04d92.jpg not downloaded yet
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_9b19fa10b41439903f13efc115c56575.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_9b19fa10b41439903f13efc115c56575.jpg not downloaded yet
2025-12-05 10:07:14 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 354
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'icc'
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: Compression method 0
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 407 9
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 428 813
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1253 35
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1300 24
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1336 41
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1389 37
2025-12-05 10:07:14 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 1438 8192
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f03950>
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_13.png HTTP/1.1" 201 0
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_1edae1e2615d8d482ad043e62e5a0807.png') HTTP/1.1" 204 0
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_1edae1e2615d8d482ad043e62e5a0807.png saved to cache
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3db3d10>
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_244d8f1d924d96e867877dafe4f994d1.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_244d8f1d924d96e867877dafe4f994d1.jpg saved to cache
2025-12-05 10:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ef4910>
2025-12-05 10:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg saved to cache
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg not downloaded yet
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_1f96ea5618384b7dca214230383514ab.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1f96ea5618384b7dca214230383514ab.jpg not downloaded yet
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: EN92319
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN92319%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for EN92319: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: MC89821
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC89821%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for MC89821: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: BY02690
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY02690%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for BY02690: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: XW80032
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW80032%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for XW80032: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: ZS43701
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS43701%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for ZS43701: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: GW70915
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW70915%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for GW70915: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: HK71653
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK71653%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for HK71653: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: BR55254
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR55254%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for BR55254: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: RD01541
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01541%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for RD01541: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: TP35774
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP35774%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for TP35774: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: AL52920
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL52920%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for AL52920: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: SH62145
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH62145%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for SH62145: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: JD19980
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD19980%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for JD19980: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: TU12930
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU12930%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for TU12930: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: WN60183
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN60183%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for WN60183: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: RW28889
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW28889%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for RW28889: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: BP94413
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP94413%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for BP94413: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: SC07928
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC07928%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for SC07928: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: GJ74171
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GJ74171%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for GJ74171: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: CG30176
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG30176%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for CG30176: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: DN68208
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN68208%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for DN68208: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: MU15343
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU15343%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for MU15343: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: NF58021
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF58021%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for NF58021: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: TM70777
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM70777%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for TM70777: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: YN23455
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN23455%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for YN23455: 0
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: SN76439
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for SN76439: 2
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg not downloaded yet
2025-12-05 10:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg not downloaded yet
2025-12-05 10:07:15 [auto1.it] INFO: Found listing with ID: DE37402
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE37402%27 HTTP/1.1" 200 None
2025-12-05 10:07:15 [auto1.it] INFO: Scrape type for DE37402: 2
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e5afd0>
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_26a5301b0d56c10c412235afa92e66ac.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_26a5301b0d56c10c412235afa92e66ac.jpg saved to cache
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3dd57d0>
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg saved to cache
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ee9a50>
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_2b5a886eac947090c1db1a0768a5f49e.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_2b5a886eac947090c1db1a0768a5f49e.jpg saved to cache
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0087cd0>
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_42bff4bff8adf5531b1614343935d56a.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_42bff4bff8adf5531b1614343935d56a.jpg saved to cache
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg not downloaded yet
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_903c35649d31eceb2ec7bd035e095dd7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_903c35649d31eceb2ec7bd035e095dd7.jpg not downloaded yet
2025-12-05 10:07:16 [auto1.it] INFO: Found listing with ID: RS56178
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56178%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [auto1.it] INFO: Scrape type for RS56178: 2
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg not downloaded yet
2025-12-05 10:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:16 [auto1.it] INFO: Found listing with ID: CH47272
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH47272%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [auto1.it] INFO: Scrape type for CH47272: 2
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_42f5d6312244b637b9af08a85c132b79.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_42f5d6312244b637b9af08a85c132b79.jpg not downloaded yet
2025-12-05 10:07:16 [auto1.it] INFO: Found listing with ID: UZ70339
2025-12-05 10:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ70339%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for UZ70339: 2
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_05ae44d26fa85e70577d197272d3d231.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_05ae44d26fa85e70577d197272d3d231.jpg not downloaded yet
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_2664a918befefcb2a112ab081ab04d92.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [auto1.it] INFO: Found listing with ID: BZ67729
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ67729%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for BZ67729: 2
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_7b1679a6dd2452835f7c95d381719ac6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg not downloaded yet
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [auto1.it] INFO: Found listing with ID: TG21070
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG21070%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for TG21070: 2
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg not downloaded yet
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_9b19fa10b41439903f13efc115c56575.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [auto1.it] INFO: Found listing with ID: VK07610
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for VK07610: 2
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg not downloaded yet
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34d5f90>
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg saved to cache
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:17 [auto1.it] INFO: Found listing with ID: MT07045
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT07045%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for MT07045: 2
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg not downloaded yet
2025-12-05 10:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_05ae44d26fa85e70577d197272d3d231.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:17 [auto1.it] INFO: Found listing with ID: UL05491
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL05491%27 HTTP/1.1" 200 None
2025-12-05 10:07:17 [auto1.it] INFO: Scrape type for UL05491: 2
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eeea50>
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_2664a918befefcb2a112ab081ab04d92.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_2664a918befefcb2a112ab081ab04d92.jpg saved to cache
2025-12-05 10:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3372d50>
2025-12-05 10:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_7b1679a6dd2452835f7c95d381719ac6.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_7b1679a6dd2452835f7c95d381719ac6.jpg saved to cache
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d72c10>
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg saved to cache
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f17fd0>
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_9b19fa10b41439903f13efc115c56575.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_9b19fa10b41439903f13efc115c56575.jpg saved to cache
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:18 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 36 pages/min), scraped 102 items (at 16 items/min)
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_07222e23329d1c56262f3c850f3da756.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_07222e23329d1c56262f3c850f3da756.jpg not downloaded yet
2025-12-05 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:18 [auto1.it] INFO: Found listing with ID: CN91272
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN91272%27 HTTP/1.1" 200 None
2025-12-05 10:07:18 [auto1.it] INFO: Scrape type for CN91272: 2
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg not downloaded yet
2025-12-05 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH57663> (referer: https://www.auto1.com/v1/car-details-view/SH57663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d1c190>
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg saved to cache
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e53790>
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_05ae44d26fa85e70577d197272d3d231.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_05ae44d26fa85e70577d197272d3d231.jpg saved to cache
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:19 [auto1.it] INFO: Found listing with ID: LZ55046
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ55046%27 HTTP/1.1" 200 None
2025-12-05 10:07:19 [auto1.it] INFO: Scrape type for LZ55046: 2
2025-12-05 10:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_82c8cd4db99940901359c568cadc58f9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_82c8cd4db99940901359c568cadc58f9.jpg not downloaded yet
2025-12-05 10:07:19 [auto1.it] INFO: Found listing with ID: XR03874
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03874%27 HTTP/1.1" 200 None
2025-12-05 10:07:19 [auto1.it] INFO: Scrape type for XR03874: 2
2025-12-05 10:07:19 [auto1.it] INFO: Found listing with ID: TY20988
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY20988%27 HTTP/1.1" 200 None
2025-12-05 10:07:19 [auto1.it] INFO: Scrape type for TY20988: 2
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3042c50>
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg saved to cache
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a89bab39-60fd-57c7-a691-2296fd29a51c with identifier: SH57663
2025-12-05 10:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a89bab39-60fd-57c7-a691-2296fd29a51c with scrape type 2
2025-12-05 10:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a89bab39-60fd-57c7-a691-2296fd29a51c with scrape type 2
2025-12-05 10:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a89bab39-60fd-57c7-a691-2296fd29a51c, identifier: SH57663
2025-12-05 10:07:20 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a89bab39-60fd-57c7-a691-2296fd29a51c with identifier: SH57663
2025-12-05 10:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a89bab39-60fd-57c7-a691-2296fd29a51c with identifier: SH57663
2025-12-05 10:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2025-12-05 10:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a89bab39-60fd-57c7-a691-2296fd29a51c spider: auto1.it
2025-12-05 10:07:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a89bab39-60fd-57c7-a691-2296fd29a51c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-06T16:50:12Z',
 'fuel_type': 'diesel',
 'id': 'a89bab39-60fd-57c7-a691-2296fd29a51c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH57663',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 149796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Club XS',
 'transmission': 'manual',
 'trim': 'Club XS',
 'year': 2019}
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH57663%27 HTTP/1.1" 200 None
2025-12-05 10:07:20 [auto1.it] INFO: Saving data for SH57663: {'auction_closing_time': 1765039812.0, 'created_time': 1763028145.089922, 'last_price_update_time': 1764929240.423194}
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH57663') HTTP/1.1" 204 0
2025-12-05 10:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_07222e23329d1c56262f3c850f3da756.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:20 [auto1.it] INFO: Found listing with ID: YL24739
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL24739%27 HTTP/1.1" 200 None
2025-12-05 10:07:20 [auto1.it] INFO: Scrape type for YL24739: 2
2025-12-05 10:07:20 [auto1.it] INFO: Found listing with ID: GY05920
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2025-12-05 10:07:20 [auto1.it] INFO: Scrape type for GY05920: 2
2025-12-05 10:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU49285> (referer: https://www.auto1.com/v1/car-details-view/VU49285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:20 [auto1.it] INFO: Found listing with ID: RD01176
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01176%27 HTTP/1.1" 200 None
2025-12-05 10:07:20 [auto1.it] INFO: Scrape type for RD01176: 2
2025-12-05 10:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ebe210>
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg saved to cache
2025-12-05 10:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:20 [auto1.it] INFO: Found listing with ID: JS24546
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS24546%27 HTTP/1.1" 200 None
2025-12-05 10:07:20 [auto1.it] INFO: Scrape type for JS24546: 2
2025-12-05 10:07:21 [auto1.it] INFO: Found listing with ID: ZB29896
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB29896%27 HTTP/1.1" 200 None
2025-12-05 10:07:21 [auto1.it] INFO: Scrape type for ZB29896: 2
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da335e0d0>
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg saved to cache
2025-12-05 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d40190>
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_07222e23329d1c56262f3c850f3da756.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_07222e23329d1c56262f3c850f3da756.jpg saved to cache
2025-12-05 10:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0084710>
2025-12-05 10:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg saved to cache
2025-12-05 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ea8795-b44f-5c1c-9bff-3797256681fd with identifier: VU49285
2025-12-05 10:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ea8795-b44f-5c1c-9bff-3797256681fd with scrape type 2
2025-12-05 10:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ea8795-b44f-5c1c-9bff-3797256681fd with scrape type 2
2025-12-05 10:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81ea8795-b44f-5c1c-9bff-3797256681fd, identifier: VU49285
2025-12-05 10:07:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3faec90>
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg saved to cache
2025-12-05 10:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81ea8795-b44f-5c1c-9bff-3797256681fd with identifier: VU49285
2025-12-05 10:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81ea8795-b44f-5c1c-9bff-3797256681fd with identifier: VU49285
2025-12-05 10:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176482 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176482
2025-12-05 10:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 81ea8795-b44f-5c1c-9bff-3797256681fd spider: auto1.it
2025-12-05 10:07:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 81ea8795-b44f-5c1c-9bff-3797256681fd due to rule: high_mileage_for_country.json, error: 176482 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176482
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:11:29Z',
 'fuel_type': 'diesel',
 'id': '81ea8795-b44f-5c1c-9bff-3797256681fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU49285',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 176482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Energy Grand Business Edition',
 'transmission': 'manual',
 'trim': 'Grand Business Edition',
 'year': 2017}
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU49285%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Saving data for VU49285: {'auction_closing_time': 1764951089.0, 'created_time': 1764014650.992177, 'last_price_update_time': 1764929243.269251}
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU49285') HTTP/1.1" 204 0
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: WP71801
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71801%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for WP71801: 2
2025-12-05 10:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ67729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: LG15612
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG15612%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for LG15612: 2
2025-12-05 10:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: TJ47835
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ47835%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for TJ47835: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: CW51331
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW51331%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for CW51331: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: XY59985
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY59985%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for XY59985: 0
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: ZC72396
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC72396%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for ZC72396: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: JM46958
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM46958%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for JM46958: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: LR58377
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR58377%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for LR58377: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: YP57818
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for YP57818: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: DY09053
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY09053%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for DY09053: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: VH90153
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH90153%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for VH90153: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: PF55031
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF55031%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for PF55031: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: YK03588
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for YK03588: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: TH40683
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH40683%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for TH40683: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: BE54104
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for BE54104: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: WH55073
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55073%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for WH55073: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: TX41333
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX41333%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for TX41333: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: SU51578
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU51578%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for SU51578: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: KP05731
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP05731%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for KP05731: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: YH36098
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for YH36098: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: TS29601
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS29601%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for TS29601: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: SC05973
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05973%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for SC05973: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: VN73607
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN73607%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for VN73607: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: BN56520
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN56520%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for BN56520: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: DX04258
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX04258%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for DX04258: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: UX08705
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX08705%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for UX08705: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: XF13981
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF13981%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for XF13981: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: AR46533
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR46533%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for AR46533: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: WC84957
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC84957%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for WC84957: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: LZ25760
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for LZ25760: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: UD94632
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for UD94632: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: CR95070
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR95070%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for CR95070: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: XD59619
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for XD59619: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: DM24491
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM24491%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for DM24491: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: KH83938
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH83938%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for KH83938: 2
2025-12-05 10:07:23 [auto1.it] INFO: Found listing with ID: XY45470
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY45470%27 HTTP/1.1" 200 None
2025-12-05 10:07:23 [auto1.it] INFO: Scrape type for XY45470: 2
2025-12-05 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png> (referer: https://www.auto1.com/)
2025-12-05 10:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB67400/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 361
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'ICC Profile'
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: Compression method 0
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 414 9
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'tEXt' 435 26
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'tEXt' 473 15
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'tIME' 500 7
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: b'tIME' 500 7 (unknown)
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'tEXt' 519 32
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'iTXt' 563 2443
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'tEXt' 3018 33
2025-12-05 10:07:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 3063 62473
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3faf750>
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_14.png HTTP/1.1" 201 0
2025-12-05 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png') HTTP/1.1" 204 0
2025-12-05 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png saved to cache
2025-12-05 10:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ70339/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT07045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:26 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: UB24142
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB24142%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for UB24142: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: YS60698
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for YS60698: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: SH46646
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH46646%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for SH46646: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: ZN73329
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN73329%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for ZN73329: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: DC75270
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for DC75270: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: AR79797
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR79797%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for AR79797: 2
2025-12-05 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN91272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: CX00629
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX00629%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for CX00629: 2
2025-12-05 10:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: KX58847
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX58847%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for KX58847: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: VJ55354
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ55354%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for VJ55354: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: RT83017
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT83017%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for RT83017: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: HG49164
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG49164%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for HG49164: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: HY00654
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for HY00654: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: PT73799
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT73799%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for PT73799: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: DG68418
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG68418%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for DG68418: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: JV35626
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV35626%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for JV35626: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: BD13834
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for BD13834: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: FE68009
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE68009%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for FE68009: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: RG65922
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG65922%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for RG65922: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: LJ12272
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ12272%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for LJ12272: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: KM42492
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM42492%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for KM42492: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: PZ64789
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ64789%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for PZ64789: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: AJ43419
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ43419%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for AJ43419: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: VJ87382
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for VJ87382: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: FW14756
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW14756%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for FW14756: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: BT06439
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for BT06439: 2
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: BG97332
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG97332%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for BG97332: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: ZU44303
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU44303%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for ZU44303: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: SH03361
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH03361%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for SH03361: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: KJ19312
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ19312%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for KJ19312: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: NZ23957
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for NZ23957: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: EL05758
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL05758%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for EL05758: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: BB58420
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB58420%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for BB58420: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: NH65511
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH65511%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for NH65511: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: TW97346
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW97346%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for TW97346: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: HE14591
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE14591%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for HE14591: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: UJ58840
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ58840%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for UJ58840: 0
2025-12-05 10:07:26 [auto1.it] INFO: Found listing with ID: LS41855
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS41855%27 HTTP/1.1" 200 None
2025-12-05 10:07:26 [auto1.it] INFO: Scrape type for LS41855: 0
2025-12-05 10:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB29896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS24546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL05491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD37849> (referer: https://www.auto1.com/v1/car-details-view/FD37849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799b05b9-5d1d-5c1c-8151-22d179b46160 with identifier: FD37849
2025-12-05 10:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799b05b9-5d1d-5c1c-8151-22d179b46160 with scrape type 2
2025-12-05 10:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 799b05b9-5d1d-5c1c-8151-22d179b46160 with scrape type 2
2025-12-05 10:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 799b05b9-5d1d-5c1c-8151-22d179b46160, identifier: FD37849
2025-12-05 10:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 799b05b9-5d1d-5c1c-8151-22d179b46160 with identifier: FD37849
2025-12-05 10:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 799b05b9-5d1d-5c1c-8151-22d179b46160 with identifier: FD37849
2025-12-05 10:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 799b05b9-5d1d-5c1c-8151-22d179b46160 with identifier: FD37849 to the API
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD37849>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2025-12-06T16:55:58Z',
 'fuel_type': 'petrol',
 'id': '799b05b9-5d1d-5c1c-8151-22d179b46160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD37849',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 45911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD37849%27 HTTP/1.1" 200 None
2025-12-05 10:07:30 [auto1.it] INFO: Saving data for FD37849: {'auction_closing_time': 1765040158.0, 'created_time': 1762287234.258551, 'last_price_update_time': 1764929250.896926}
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD37849') HTTP/1.1" 204 0
2025-12-05 10:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY45470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH83938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY90448> (referer: https://www.auto1.com/v1/car-details-view/LY90448/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 928df009-75b0-5185-93e5-f374c4b5c296 with identifier: LY90448
2025-12-05 10:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 928df009-75b0-5185-93e5-f374c4b5c296 with scrape type 2
2025-12-05 10:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 928df009-75b0-5185-93e5-f374c4b5c296 with scrape type 2
2025-12-05 10:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 928df009-75b0-5185-93e5-f374c4b5c296, identifier: LY90448
2025-12-05 10:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 928df009-75b0-5185-93e5-f374c4b5c296 with identifier: LY90448
2025-12-05 10:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 928df009-75b0-5185-93e5-f374c4b5c296 with identifier: LY90448
2025-12-05 10:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 928df009-75b0-5185-93e5-f374c4b5c296 with identifier: LY90448 to the API
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY90448>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-06T16:12:44Z',
 'fuel_type': 'petrol',
 'id': '928df009-75b0-5185-93e5-f374c4b5c296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY90448',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 50424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Executive Premium',
 'transmission': 'manual',
 'trim': 'Executive Premium',
 'year': 2019}
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY90448%27 HTTP/1.1" 200 None
2025-12-05 10:07:36 [auto1.it] INFO: Saving data for LY90448: {'auction_closing_time': 1765037564.0, 'created_time': 1763719238.468352, 'last_price_update_time': 1764929256.715292}
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY90448') HTTP/1.1" 204 0
2025-12-05 10:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB67400> (referer: https://www.auto1.com/v1/car-details-view/HB67400/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with identifier: HB67400
2025-12-05 10:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with scrape type 1
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_6557160aee6fb6515289271b94ee12f2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_6557160aee6fb6515289271b94ee12f2.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_4860109dedc0ffac9209f2352fcad617.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_4860109dedc0ffac9209f2352fcad617.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_686d85d3cdaedde97e0b929f74bb4858.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_686d85d3cdaedde97e0b929f74bb4858.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_422c06888117348aecb93f06efc74cd2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_422c06888117348aecb93f06efc74cd2.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_5c24be9e0202ace66a01d917935876b6.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_5c24be9e0202ace66a01d917935876b6.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_b9126116e795e25e7c82ec6216a477f4.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_b9126116e795e25e7c82ec6216a477f4.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_ea09bb6938152762791c3a97de82094f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_ea09bb6938152762791c3a97de82094f.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_156fc7ddd3e926e753fa778118d16b63.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_156fc7ddd3e926e753fa778118d16b63.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_965de44971d4735e90b922eeac5ba9e2.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_965de44971d4735e90b922eeac5ba9e2.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_a39c0b102821dff4a441357b1c68b8a1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_a39c0b102821dff4a441357b1c68b8a1.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_d48ed870872a65b76d432b9df92a00eb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_d48ed870872a65b76d432b9df92a00eb.jpg not downloaded yet
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg not downloaded yet
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR79797/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD01176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM24491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ70339> (referer: https://www.auto1.com/v1/car-details-view/UZ70339/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6d4f17-0483-5315-8555-4c8348192d52 with identifier: UZ70339
2025-12-05 10:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6d4f17-0483-5315-8555-4c8348192d52 with scrape type 2
2025-12-05 10:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6d4f17-0483-5315-8555-4c8348192d52 with scrape type 2
2025-12-05 10:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b6d4f17-0483-5315-8555-4c8348192d52, identifier: UZ70339
2025-12-05 10:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_d48ed870872a65b76d432b9df92a00eb.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b6d4f17-0483-5315-8555-4c8348192d52 with identifier: UZ70339
2025-12-05 10:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b6d4f17-0483-5315-8555-4c8348192d52 with identifier: UZ70339
2025-12-05 10:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b6d4f17-0483-5315-8555-4c8348192d52 with identifier: UZ70339 to the API
2025-12-05 10:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ70339>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'expiration_date': '2025-12-05T16:35:29Z',
 'fuel_type': 'petrol',
 'id': '1b6d4f17-0483-5315-8555-4c8348192d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ70339',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 12284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.5 VGT Ti',
 'transmission': 'automatic',
 'trim': 'Ti',
 'year': 2023}
2025-12-05 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ70339%27 HTTP/1.1" 200 None
2025-12-05 10:07:39 [auto1.it] INFO: Saving data for UZ70339: {'auction_closing_time': 1764952529.0, 'created_time': 1760385743.194259, 'last_price_update_time': 1764929259.983249}
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ70339') HTTP/1.1" 204 0
2025-12-05 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_a39c0b102821dff4a441357b1c68b8a1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db1ea39d0>
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg saved to cache
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da303fad0>
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_d48ed870872a65b76d432b9df92a00eb.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_d48ed870872a65b76d432b9df92a00eb.jpg saved to cache
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db0096110>
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_a39c0b102821dff4a441357b1c68b8a1.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_a39c0b102821dff4a441357b1c68b8a1.jpg saved to cache
2025-12-05 10:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3082250>
2025-12-05 10:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg saved to cache
2025-12-05 10:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_965de44971d4735e90b922eeac5ba9e2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW14756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP71801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_156fc7ddd3e926e753fa778118d16b63.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_ea09bb6938152762791c3a97de82094f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da336bdd0>
2025-12-05 10:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_965de44971d4735e90b922eeac5ba9e2.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_965de44971d4735e90b922eeac5ba9e2.jpg saved to cache
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_b9126116e795e25e7c82ec6216a477f4.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_5c24be9e0202ace66a01d917935876b6.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34d5f90>
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_156fc7ddd3e926e753fa778118d16b63.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_156fc7ddd3e926e753fa778118d16b63.jpg saved to cache
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3ebc850>
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_ea09bb6938152762791c3a97de82094f.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_ea09bb6938152762791c3a97de82094f.jpg saved to cache
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e92e90>
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg saved to cache
2025-12-05 10:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_422c06888117348aecb93f06efc74cd2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_686d85d3cdaedde97e0b929f74bb4858.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f4f5d0>
2025-12-05 10:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_b9126116e795e25e7c82ec6216a477f4.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_b9126116e795e25e7c82ec6216a477f4.jpg saved to cache
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3082250>
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_5c24be9e0202ace66a01d917935876b6.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_5c24be9e0202ace66a01d917935876b6.jpg saved to cache
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3083f50>
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg saved to cache
2025-12-05 10:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_4860109dedc0ffac9209f2352fcad617.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bec90>
2025-12-05 10:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_422c06888117348aecb93f06efc74cd2.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_422c06888117348aecb93f06efc74cd2.jpg saved to cache
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3370410>
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_686d85d3cdaedde97e0b929f74bb4858.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_686d85d3cdaedde97e0b929f74bb4858.jpg saved to cache
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3444c10>
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_4860109dedc0ffac9209f2352fcad617.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_4860109dedc0ffac9209f2352fcad617.jpg saved to cache
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_6557160aee6fb6515289271b94ee12f2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT06439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34bedd0>
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F1a%252Ffb1a391c9642300243797a8a1e857e4f%252Fpa%252FHB67400_6557160aee6fb6515289271b94ee12f2.jpg') HTTP/1.1" 204 0
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_6557160aee6fb6515289271b94ee12f2.jpg saved to cache
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434
2025-12-05 10:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434, skipping ID generation
2025-12-05 10:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with scrape type 1
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 from tracking dictionaries
2025-12-05 10:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 sending to next pipeline
2025-12-05 10:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434, identifier: HB67400
2025-12-05 10:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with identifier: HB67400
2025-12-05 10:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with identifier: HB67400
2025-12-05 10:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2c3bd2e-7e35-5caf-ad32-b1c5541ed434 with identifier: HB67400 to the API
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_6557160aee6fb6515289271b94ee12f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-06T16:57:42Z',
 'fuel_type': 'petrol',
 'id': 'f2c3bd2e-7e35-5caf-ad32-b1c5541ed434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB67400',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 52387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_6557160aee6fb6515289271b94ee12f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_4860109dedc0ffac9209f2352fcad617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_686d85d3cdaedde97e0b929f74bb4858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_422c06888117348aecb93f06efc74cd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_5c24be9e0202ace66a01d917935876b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_38249c2ccbfe96aca516300eaa9d3d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_b9126116e795e25e7c82ec6216a477f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_ea09bb6938152762791c3a97de82094f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_e04701d5a1e8192bce41b8c2efe5ca7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_156fc7ddd3e926e753fa778118d16b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_965de44971d4735e90b922eeac5ba9e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_fe3d32d1c151e0da6657017e4a5b80b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_a39c0b102821dff4a441357b1c68b8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_d48ed870872a65b76d432b9df92a00eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c3bd2e-7e35-5caf-ad32-b1c5541ed434/f2c3bd2e-7e35-5caf-ad32-b1c5541ed434_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/1a/fb1a391c9642300243797a8a1e857e4f/pa/HB67400_96e55b6eaf1d0e4b02e9c1749a75221e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2020}
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB67400%27 HTTP/1.1" 200 None
2025-12-05 10:07:45 [auto1.it] INFO: Saving data for HB67400: {'created_time': 1764929265.54928, 'last_price_update_time': 1764929265.549292, 'auction_closing_time': 1765040262.0}
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB67400') HTTP/1.1" 204 0
2025-12-05 10:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS24546> (referer: https://www.auto1.com/v1/car-details-view/JS24546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with identifier: JS24546
2025-12-05 10:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with scrape type 2
2025-12-05 10:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with scrape type 2
2025-12-05 10:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52f2e43d-e973-5b8d-9469-1ceb5a57ed53, identifier: JS24546
2025-12-05 10:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with identifier: JS24546
2025-12-05 10:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with identifier: JS24546
2025-12-05 10:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52f2e43d-e973-5b8d-9469-1ceb5a57ed53 with identifier: JS24546 to the API
2025-12-05 10:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JS24546>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:58:33Z',
 'fuel_type': 'petrol',
 'id': '52f2e43d-e973-5b8d-9469-1ceb5a57ed53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS24546',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 103046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2025-12-05 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS24546%27 HTTP/1.1" 200 None
2025-12-05 10:07:47 [auto1.it] INFO: Saving data for JS24546: {'auction_closing_time': 1764953913.0, 'created_time': 1762286656.431943, 'last_price_update_time': 1764929267.056992}
2025-12-05 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS24546') HTTP/1.1" 204 0
2025-12-05 10:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY45470> (referer: https://www.auto1.com/v1/car-details-view/XY45470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with identifier: XY45470
2025-12-05 10:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with scrape type 2
2025-12-05 10:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with scrape type 2
2025-12-05 10:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21cfac40-4710-5290-a1b3-e1d4ec455bd2, identifier: XY45470
2025-12-05 10:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with identifier: XY45470
2025-12-05 10:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with identifier: XY45470
2025-12-05 10:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21cfac40-4710-5290-a1b3-e1d4ec455bd2 with identifier: XY45470 to the API
2025-12-05 10:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY45470>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2025-12-05T16:54:15Z',
 'fuel_type': 'diesel',
 'id': '21cfac40-4710-5290-a1b3-e1d4ec455bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY45470',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 126904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Titanium 4x4',
 'transmission': 'automatic',
 'trim': 'Titanium 4x4',
 'year': 2017}
2025-12-05 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY45470%27 HTTP/1.1" 200 None
2025-12-05 10:07:51 [auto1.it] INFO: Saving data for XY45470: {'auction_closing_time': 1764953655.0, 'created_time': 1762287220.054642, 'last_price_update_time': 1764929271.065202}
2025-12-05 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY45470') HTTP/1.1" 204 0
2025-12-05 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL05491> (referer: https://www.auto1.com/v1/car-details-view/UL05491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with identifier: UL05491
2025-12-05 10:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with scrape type 2
2025-12-05 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with scrape type 2
2025-12-05 10:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a, identifier: UL05491
2025-12-05 10:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with identifier: UL05491
2025-12-05 10:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with identifier: UL05491
2025-12-05 10:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a with identifier: UL05491 to the API
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL05491>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2025-12-05T16:44:45Z',
 'fuel_type': 'diesel',
 'id': 'ba79ad52-0ca9-57ed-9922-2c8bdbf06c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL05491',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 97742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.0 M-Jet Limited 4WD',
 'transmission': 'manual',
 'trim': 'Limited 4WD',
 'year': 2017}
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL05491%27 HTTP/1.1" 200 None
2025-12-05 10:07:52 [auto1.it] INFO: Saving data for UL05491: {'auction_closing_time': 1764953085.0, 'created_time': 1764842565.171517, 'last_price_update_time': 1764929272.635306}
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL05491') HTTP/1.1" 204 0
2025-12-05 10:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH83938> (referer: https://www.auto1.com/v1/car-details-view/KH83938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a62912-0a55-5cf9-b531-09f12d7a35ac with identifier: KH83938
2025-12-05 10:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a62912-0a55-5cf9-b531-09f12d7a35ac with scrape type 2
2025-12-05 10:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83a62912-0a55-5cf9-b531-09f12d7a35ac with scrape type 2
2025-12-05 10:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83a62912-0a55-5cf9-b531-09f12d7a35ac, identifier: KH83938
2025-12-05 10:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83a62912-0a55-5cf9-b531-09f12d7a35ac with identifier: KH83938
2025-12-05 10:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83a62912-0a55-5cf9-b531-09f12d7a35ac with identifier: KH83938
2025-12-05 10:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83a62912-0a55-5cf9-b531-09f12d7a35ac with identifier: KH83938 to the API
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH83938>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2025-12-05T16:54:51Z',
 'fuel_type': 'diesel',
 'id': '83a62912-0a55-5cf9-b531-09f12d7a35ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH83938',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 75669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2021}
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH83938%27 HTTP/1.1" 200 None
2025-12-05 10:07:53 [auto1.it] INFO: Saving data for KH83938: {'auction_closing_time': 1764953691.0, 'created_time': 1764446459.958591, 'last_price_update_time': 1764929273.241267}
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KH83938') HTTP/1.1" 204 0
2025-12-05 10:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM24491> (referer: https://www.auto1.com/v1/car-details-view/DM24491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9bb518d-d55c-5182-b2a0-2b728b943ee9 with identifier: DM24491
2025-12-05 10:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9bb518d-d55c-5182-b2a0-2b728b943ee9 with scrape type 2
2025-12-05 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9bb518d-d55c-5182-b2a0-2b728b943ee9 with scrape type 2
2025-12-05 10:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9bb518d-d55c-5182-b2a0-2b728b943ee9, identifier: DM24491
2025-12-05 10:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9bb518d-d55c-5182-b2a0-2b728b943ee9 with identifier: DM24491
2025-12-05 10:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9bb518d-d55c-5182-b2a0-2b728b943ee9 with identifier: DM24491
2025-12-05 10:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong xlv 1.6 dream 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'xlv', 'transmission': 'automatic', 'odometer': 102438, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm24491', 'expiration_date': '2025-12-05t16:29:48z', 'origin_country_code': 'it', 'trim': 'dream 4x2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, castelnuovo del garda (vr)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 173, 'id': 'a9bb518d-d55c-5182-b2a0-2b728b943ee9', 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'ssangyong xlv', 'sanitized_make': 'ssangyong', 'odometer_in_km': 102438}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 173,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2025-12-05t16:29:48z',
     'fuel_type': 'petrol',
     'id': 'a9bb518d-d55c-5182-b2a0-2b728b943ee9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm24491',
     'listing': 'auction',
     'location': 'it, castelnuovo del garda (vr)',
     'make': 'ssangyong',
     'make_model': 'ssangyong xlv',
     'model': 'xlv',
     'odometer': 102438,
     'odometer_in_km': 102438,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-29',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong xlv 1.6 dream 4x2',
     'transmission': 'automatic',
     'trim': 'dream 4x2',
     'year': 2020}
2025-12-05 10:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: a9bb518d-d55c-5182-b2a0-2b728b943ee9 spider: auto1.it
2025-12-05 10:07:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a9bb518d-d55c-5182-b2a0-2b728b943ee9 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong xlv 1.6 dream 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'xlv', 'transmission': 'automatic', 'odometer': 102438, 'odometer_reading_unit': 'km', 'registration_date': '2020-01-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm24491', 'expiration_date': '2025-12-05t16:29:48z', 'origin_country_code': 'it', 'trim': 'dream 4x2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, castelnuovo del garda (vr)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 173, 'id': 'a9bb518d-d55c-5182-b2a0-2b728b943ee9', 'current_year_diff': 5, 'age_in_months': 70, 'make_model': 'ssangyong xlv', 'sanitized_make': 'ssangyong', 'odometer_in_km': 102438}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': 173,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2025-12-05t16:29:48z',
     'fuel_type': 'petrol',
     'id': 'a9bb518d-d55c-5182-b2a0-2b728b943ee9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm24491',
     'listing': 'auction',
     'location': 'it, castelnuovo del garda (vr)',
     'make': 'ssangyong',
     'make_model': 'ssangyong xlv',
     'model': 'xlv',
     'odometer': 102438,
     'odometer_in_km': 102438,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-01-29',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong xlv 1.6 dream 4x2',
     'transmission': 'automatic',
     'trim': 'dream 4x2',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.6L',
 'engine_horse_power': 128,
 'expiration_date': '2025-12-05T16:29:48Z',
 'fuel_type': 'petrol',
 'id': 'a9bb518d-d55c-5182-b2a0-2b728b943ee9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM24491',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Ssangyong',
 'model': 'XLV',
 'odometer': 102438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong XLV 1.6 Dream 4x2',
 'transmission': 'automatic',
 'trim': 'Dream 4x2',
 'year': 2020}
2025-12-05 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM24491%27 HTTP/1.1" 200 None
2025-12-05 10:07:54 [auto1.it] INFO: Saving data for DM24491: {'auction_closing_time': 1764952188.0, 'created_time': 1760212868.186974, 'last_price_update_time': 1764929274.726766}
2025-12-05 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DM24491') HTTP/1.1" 204 0
2025-12-05 10:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD01176> (referer: https://www.auto1.com/v1/car-details-view/RD01176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add5faaf-9704-50c2-8ad5-7bfcd40a43ed with identifier: RD01176
2025-12-05 10:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add5faaf-9704-50c2-8ad5-7bfcd40a43ed with scrape type 2
2025-12-05 10:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add5faaf-9704-50c2-8ad5-7bfcd40a43ed with scrape type 2
2025-12-05 10:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: add5faaf-9704-50c2-8ad5-7bfcd40a43ed, identifier: RD01176
2025-12-05 10:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: add5faaf-9704-50c2-8ad5-7bfcd40a43ed with identifier: RD01176
2025-12-05 10:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: add5faaf-9704-50c2-8ad5-7bfcd40a43ed with identifier: RD01176
2025-12-05 10:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: add5faaf-9704-50c2-8ad5-7bfcd40a43ed with identifier: RD01176 to the API
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD01176>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:34:42Z',
 'fuel_type': 'petrol',
 'id': 'add5faaf-9704-50c2-8ad5-7bfcd40a43ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD01176',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 60348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2022}
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD01176%27 HTTP/1.1" 200 None
2025-12-05 10:07:55 [auto1.it] INFO: Saving data for RD01176: {'auction_closing_time': 1764952482.0, 'created_time': 1762891571.118576, 'last_price_update_time': 1764929275.302006}
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD01176') HTTP/1.1" 204 0
2025-12-05 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ87382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW14756> (referer: https://www.auto1.com/v1/car-details-view/FW14756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c87b71e-26e4-5328-b90e-fa22434163db with identifier: FW14756
2025-12-05 10:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c87b71e-26e4-5328-b90e-fa22434163db with scrape type 2
2025-12-05 10:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c87b71e-26e4-5328-b90e-fa22434163db with scrape type 2
2025-12-05 10:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c87b71e-26e4-5328-b90e-fa22434163db, identifier: FW14756
2025-12-05 10:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c87b71e-26e4-5328-b90e-fa22434163db with identifier: FW14756
2025-12-05 10:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c87b71e-26e4-5328-b90e-fa22434163db with identifier: FW14756
2025-12-05 10:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2025-12-05 10:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4c87b71e-26e4-5328-b90e-fa22434163db spider: auto1.it
2025-12-05 10:07:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4c87b71e-26e4-5328-b90e-fa22434163db due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-05T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '4c87b71e-26e4-5328-b90e-fa22434163db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW14756',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 58310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2021}
2025-12-05 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW14756%27 HTTP/1.1" 200 None
2025-12-05 10:07:59 [auto1.it] INFO: Saving data for FW14756: {'auction_closing_time': 1764951351.0, 'created_time': 1764842531.500707, 'last_price_update_time': 1764929279.51633}
2025-12-05 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW14756') HTTP/1.1" 204 0
2025-12-05 10:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ12272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT06439> (referer: https://www.auto1.com/v1/car-details-view/BT06439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2025-12-05 10:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25de4bc9-6fda-595b-ac3e-725078b60151 with scrape type 2
2025-12-05 10:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25de4bc9-6fda-595b-ac3e-725078b60151 with scrape type 2
2025-12-05 10:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25de4bc9-6fda-595b-ac3e-725078b60151, identifier: BT06439
2025-12-05 10:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2025-12-05 10:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439
2025-12-05 10:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25de4bc9-6fda-595b-ac3e-725078b60151 with identifier: BT06439 to the API
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT06439>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2025-12-05T16:28:37Z',
 'fuel_type': 'diesel',
 'id': '25de4bc9-6fda-595b-ac3e-725078b60151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT06439',
 'listing': 'auction',
 'location': 'IT, Treviolo',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 100006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2019}
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT06439%27 HTTP/1.1" 200 None
2025-12-05 10:08:02 [auto1.it] INFO: Saving data for BT06439: {'auction_closing_time': 1764952117.0, 'created_time': 1764842544.76598, 'last_price_update_time': 1764929282.397721}
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT06439') HTTP/1.1" 204 0
2025-12-05 10:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG65922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE68009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD13834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV35626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:17 [scrapy.extensions.logstats] INFO: Crawled 335 pages (at 36 pages/min), scraped 112 items (at 10 items/min)
2025-12-05 10:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG68418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP71801> (referer: https://www.auto1.com/v1/car-details-view/WP71801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606420df-0c3f-5714-a00d-23273f6f5594 with identifier: WP71801
2025-12-05 10:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606420df-0c3f-5714-a00d-23273f6f5594 with scrape type 2
2025-12-05 10:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606420df-0c3f-5714-a00d-23273f6f5594 with scrape type 2
2025-12-05 10:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 606420df-0c3f-5714-a00d-23273f6f5594, identifier: WP71801
2025-12-05 10:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 606420df-0c3f-5714-a00d-23273f6f5594 with identifier: WP71801
2025-12-05 10:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 606420df-0c3f-5714-a00d-23273f6f5594 with identifier: WP71801
2025-12-05 10:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2025-12-05 10:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 606420df-0c3f-5714-a00d-23273f6f5594 spider: auto1.it
2025-12-05 10:08:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 606420df-0c3f-5714-a00d-23273f6f5594 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2025-12-05T16:05:32Z',
 'fuel_type': 'petrol',
 'id': '606420df-0c3f-5714-a00d-23273f6f5594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP71801',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 16227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid Red',
 'transmission': 'manual',
 'trim': 'Red',
 'year': 2023}
2025-12-05 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP71801%27 HTTP/1.1" 200 None
2025-12-05 10:08:27 [auto1.it] INFO: Saving data for WP71801: {'auction_closing_time': 1764950732.0, 'created_time': 1763669468.72881, 'last_price_update_time': 1764929307.429514}
2025-12-05 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP71801') HTTP/1.1" 204 0
2025-12-05 10:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN91272> (referer: https://www.auto1.com/v1/car-details-view/CN91272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with identifier: CN91272
2025-12-05 10:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with scrape type 2
2025-12-05 10:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with scrape type 2
2025-12-05 10:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83c7d2c5-bc9e-5037-8446-1d2fe958d09a, identifier: CN91272
2025-12-05 10:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with identifier: CN91272
2025-12-05 10:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with identifier: CN91272
2025-12-05 10:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83c7d2c5-bc9e-5037-8446-1d2fe958d09a with identifier: CN91272 to the API
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN91272>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-05T16:02:12Z',
 'fuel_type': 'diesel',
 'id': '83c7d2c5-bc9e-5037-8446-1d2fe958d09a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN91272',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 94517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2021}
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN91272%27 HTTP/1.1" 200 None
2025-12-05 10:08:33 [auto1.it] INFO: Saving data for CN91272: {'auction_closing_time': 1764950532.0, 'created_time': 1764842496.323153, 'last_price_update_time': 1764929313.487494}
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CN91272') HTTP/1.1" 204 0
2025-12-05 10:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT73799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY20988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY00654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG65922> (referer: https://www.auto1.com/v1/car-details-view/RG65922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with identifier: RG65922
2025-12-05 10:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with scrape type 2
2025-12-05 10:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with scrape type 2
2025-12-05 10:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41fa4d03-ef46-5a01-a6a1-b8fd387815ee, identifier: RG65922
2025-12-05 10:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with identifier: RG65922
2025-12-05 10:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with identifier: RG65922
2025-12-05 10:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41fa4d03-ef46-5a01-a6a1-b8fd387815ee with identifier: RG65922 to the API
2025-12-05 10:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG65922>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2025-12-05T16:08:38Z',
 'fuel_type': 'hybrid',
 'id': '41fa4d03-ef46-5a01-a6a1-b8fd387815ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG65922',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 26131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2025-12-05 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG65922%27 HTTP/1.1" 200 None
2025-12-05 10:08:42 [auto1.it] INFO: Saving data for RG65922: {'auction_closing_time': 1764950918.0, 'created_time': 1762373080.559738, 'last_price_update_time': 1764929322.167561}
2025-12-05 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG65922') HTTP/1.1" 204 0
2025-12-05 10:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ12272> (referer: https://www.auto1.com/v1/car-details-view/LJ12272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76ba410-239e-5950-a8a4-90190624a573 with identifier: LJ12272
2025-12-05 10:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a76ba410-239e-5950-a8a4-90190624a573 with scrape type 2
2025-12-05 10:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a76ba410-239e-5950-a8a4-90190624a573 with scrape type 2
2025-12-05 10:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a76ba410-239e-5950-a8a4-90190624a573, identifier: LJ12272
2025-12-05 10:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a76ba410-239e-5950-a8a4-90190624a573 with identifier: LJ12272
2025-12-05 10:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a76ba410-239e-5950-a8a4-90190624a573 with identifier: LJ12272
2025-12-05 10:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a76ba410-239e-5950-a8a4-90190624a573 with identifier: LJ12272 to the API
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ12272>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:40:54Z',
 'fuel_type': 'diesel',
 'id': 'a76ba410-239e-5950-a8a4-90190624a573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ12272',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 137615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi SW Active",
 'transmission': 'manual',
 'trim': 'SW Active',
 'year': 2017}
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ12272%27 HTTP/1.1" 200 None
2025-12-05 10:08:43 [auto1.it] INFO: Saving data for LJ12272: {'auction_closing_time': 1764952854.0, 'created_time': 1764842569.52723, 'last_price_update_time': 1764929323.874073}
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LJ12272') HTTP/1.1" 204 0
2025-12-05 10:08:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.272(s), this was the 1st time calling it.
2025-12-05 10:08:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.814802735427804 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:09:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.610(s), this was the 1st time calling it.
2025-12-05 10:09:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.340541001161069 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:09:17 [scrapy.extensions.logstats] INFO: Crawled 343 pages (at 8 pages/min), scraped 115 items (at 3 items/min)
2025-12-05 10:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB87323> (referer: https://www.auto1.com/v1/car-details-view/KB87323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120c69dc-bc82-557c-b4e9-d5578645c850 with identifier: KB87323
2025-12-05 10:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120c69dc-bc82-557c-b4e9-d5578645c850 with scrape type 2
2025-12-05 10:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 120c69dc-bc82-557c-b4e9-d5578645c850 with scrape type 2
2025-12-05 10:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 120c69dc-bc82-557c-b4e9-d5578645c850, identifier: KB87323
2025-12-05 10:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 120c69dc-bc82-557c-b4e9-d5578645c850 with identifier: KB87323
2025-12-05 10:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 120c69dc-bc82-557c-b4e9-d5578645c850 with identifier: KB87323
2025-12-05 10:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 120c69dc-bc82-557c-b4e9-d5578645c850 with identifier: KB87323 to the API
2025-12-05 10:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB87323>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2025-12-05T16:24:43Z',
 'fuel_type': 'diesel',
 'id': '120c69dc-bc82-557c-b4e9-d5578645c850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB87323',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': '8er',
 'odometer': 95625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 8er 840d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2025-12-05 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB87323%27 HTTP/1.1" 200 None
2025-12-05 10:09:21 [auto1.it] INFO: Saving data for KB87323: {'auction_closing_time': 1764951883.0, 'created_time': 1763150677.297353, 'last_price_update_time': 1764929361.202756}
2025-12-05 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KB87323') HTTP/1.1" 204 0
2025-12-05 10:09:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS87755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG68418> (referer: https://www.auto1.com/v1/car-details-view/DG68418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 816dd189-4771-50e3-8787-eed8168759d9 with identifier: DG68418
2025-12-05 10:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 816dd189-4771-50e3-8787-eed8168759d9 with scrape type 2
2025-12-05 10:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 816dd189-4771-50e3-8787-eed8168759d9 with scrape type 2
2025-12-05 10:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 816dd189-4771-50e3-8787-eed8168759d9, identifier: DG68418
2025-12-05 10:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 816dd189-4771-50e3-8787-eed8168759d9 with identifier: DG68418
2025-12-05 10:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 816dd189-4771-50e3-8787-eed8168759d9 with identifier: DG68418
2025-12-05 10:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 816dd189-4771-50e3-8787-eed8168759d9 with identifier: DG68418 to the API
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG68418>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 300,
 'expiration_date': '2025-12-05T16:21:35Z',
 'fuel_type': 'diesel',
 'id': '816dd189-4771-50e3-8787-eed8168759d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG68418',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 126042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2018}
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG68418%27 HTTP/1.1" 200 None
2025-12-05 10:09:45 [auto1.it] INFO: Saving data for DG68418: {'auction_closing_time': 1764951695.0, 'created_time': 1764619439.464828, 'last_price_update_time': 1764929385.544888}
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DG68418') HTTP/1.1" 204 0
2025-12-05 10:09:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.814(s), this was the 1st time calling it.
2025-12-05 10:09:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.871610242614385 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT83017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV35626> (referer: https://www.auto1.com/v1/car-details-view/JV35626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34241246-12d0-55d0-aaf0-7b5dbbddf824 with identifier: JV35626
2025-12-05 10:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34241246-12d0-55d0-aaf0-7b5dbbddf824 with scrape type 2
2025-12-05 10:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34241246-12d0-55d0-aaf0-7b5dbbddf824 with scrape type 2
2025-12-05 10:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34241246-12d0-55d0-aaf0-7b5dbbddf824, identifier: JV35626
2025-12-05 10:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34241246-12d0-55d0-aaf0-7b5dbbddf824 with identifier: JV35626
2025-12-05 10:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34241246-12d0-55d0-aaf0-7b5dbbddf824 with identifier: JV35626
2025-12-05 10:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34241246-12d0-55d0-aaf0-7b5dbbddf824 with identifier: JV35626 to the API
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV35626>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 156,
 'expiration_date': '2025-12-05T16:37:20Z',
 'fuel_type': 'petrol',
 'id': '34241246-12d0-55d0-aaf0-7b5dbbddf824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV35626',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'DR',
 'model': 'DR F35',
 'odometer': 30918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR F35 1.5',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV35626%27 HTTP/1.1" 200 None
2025-12-05 10:09:55 [auto1.it] INFO: Saving data for JV35626: {'auction_closing_time': 1764952640.0, 'created_time': 1764842562.747429, 'last_price_update_time': 1764929395.951208}
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV35626') HTTP/1.1" 204 0
2025-12-05 10:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT73799> (referer: https://www.auto1.com/v1/car-details-view/PT73799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB29896> (referer: https://www.auto1.com/v1/car-details-view/ZB29896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 585c91e0-f3cd-59ab-9746-6621e0aa460e with identifier: PT73799
2025-12-05 10:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 585c91e0-f3cd-59ab-9746-6621e0aa460e with scrape type 2
2025-12-05 10:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 585c91e0-f3cd-59ab-9746-6621e0aa460e with scrape type 2
2025-12-05 10:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 585c91e0-f3cd-59ab-9746-6621e0aa460e, identifier: PT73799
2025-12-05 10:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 585c91e0-f3cd-59ab-9746-6621e0aa460e with identifier: PT73799
2025-12-05 10:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 585c91e0-f3cd-59ab-9746-6621e0aa460e with identifier: PT73799
2025-12-05 10:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito tourer' containing 'vito'
2025-12-05 10:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 585c91e0-f3cd-59ab-9746-6621e0aa460e spider: auto1.it
2025-12-05 10:10:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 585c91e0-f3cd-59ab-9746-6621e0aa460e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito tourer' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-05T16:50:12Z',
 'fuel_type': 'diesel',
 'id': '585c91e0-f3cd-59ab-9746-6621e0aa460e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT73799',
 'listing': 'auction',
 'location': 'IT, Bolzano (BZ)',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 126751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-15',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI lang Pro',
 'transmission': 'automatic',
 'trim': 'lang Pro',
 'year': 2017}
2025-12-05 10:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT73799%27 HTTP/1.1" 200 None
2025-12-05 10:10:01 [auto1.it] INFO: Saving data for PT73799: {'auction_closing_time': 1764953412.0, 'created_time': 1764842550.910017, 'last_price_update_time': 1764929401.708547}
2025-12-05 10:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT73799') HTTP/1.1" 204 0
2025-12-05 10:10:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.240(s), this was the 1st time calling it.
2025-12-05 10:10:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.55789199090322 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac612ccf-85f2-5924-91ea-4315726aa0e8 with identifier: ZB29896
2025-12-05 10:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac612ccf-85f2-5924-91ea-4315726aa0e8 with scrape type 2
2025-12-05 10:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac612ccf-85f2-5924-91ea-4315726aa0e8 with scrape type 2
2025-12-05 10:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac612ccf-85f2-5924-91ea-4315726aa0e8, identifier: ZB29896
2025-12-05 10:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac612ccf-85f2-5924-91ea-4315726aa0e8 with identifier: ZB29896
2025-12-05 10:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac612ccf-85f2-5924-91ea-4315726aa0e8 with identifier: ZB29896
2025-12-05 10:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac612ccf-85f2-5924-91ea-4315726aa0e8 with identifier: ZB29896 to the API
2025-12-05 10:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB29896>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 457,
 'expiration_date': '2025-12-05T16:30:18Z',
 'fuel_type': 'petrol',
 'id': 'ac612ccf-85f2-5924-91ea-4315726aa0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB29896',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 24126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 53 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2025-12-05 10:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB29896%27 HTTP/1.1" 200 None
2025-12-05 10:10:02 [auto1.it] INFO: Saving data for ZB29896: {'auction_closing_time': 1764952218.0, 'created_time': 1763755634.561811, 'last_price_update_time': 1764929402.252833}
2025-12-05 10:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB29896') HTTP/1.1" 204 0
2025-12-05 10:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY20988> (referer: https://www.auto1.com/v1/car-details-view/TY20988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75fe14a7-378b-56f2-8c00-500f83168326 with identifier: TY20988
2025-12-05 10:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75fe14a7-378b-56f2-8c00-500f83168326 with scrape type 2
2025-12-05 10:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75fe14a7-378b-56f2-8c00-500f83168326 with scrape type 2
2025-12-05 10:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75fe14a7-378b-56f2-8c00-500f83168326, identifier: TY20988
2025-12-05 10:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75fe14a7-378b-56f2-8c00-500f83168326 with identifier: TY20988
2025-12-05 10:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75fe14a7-378b-56f2-8c00-500f83168326 with identifier: TY20988
2025-12-05 10:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75fe14a7-378b-56f2-8c00-500f83168326 with identifier: TY20988 to the API
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY20988>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-05T16:43:24Z',
 'fuel_type': 'petrol',
 'id': '75fe14a7-378b-56f2-8c00-500f83168326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20988',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 62709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY20988%27 HTTP/1.1" 200 None
2025-12-05 10:10:03 [auto1.it] INFO: Saving data for TY20988: {'auction_closing_time': 1764953004.0, 'created_time': 1764842475.775626, 'last_price_update_time': 1764929403.673557}
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY20988') HTTP/1.1" 204 0
2025-12-05 10:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:10:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.056(s), this was the 1st time calling it.
2025-12-05 10:10:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.352215263904768 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:10:17 [scrapy.extensions.logstats] INFO: Crawled 351 pages (at 8 pages/min), scraped 120 items (at 5 items/min)
2025-12-05 10:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY00654> (referer: https://www.auto1.com/v1/car-details-view/HY00654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2025-12-05 10:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ccccf40-b0da-5ae1-893a-84d50529871c with scrape type 2
2025-12-05 10:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ccccf40-b0da-5ae1-893a-84d50529871c with scrape type 2
2025-12-05 10:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ccccf40-b0da-5ae1-893a-84d50529871c, identifier: HY00654
2025-12-05 10:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2025-12-05 10:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2025-12-05 10:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654 to the API
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY00654>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2025-12-05T16:25:17Z',
 'fuel_type': 'diesel',
 'id': '4ccccf40-b0da-5ae1-893a-84d50529871c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY00654',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mazda',
 'model': '2',
 'odometer': 134964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Diesel Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2018}
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2025-12-05 10:10:22 [auto1.it] INFO: Saving data for HY00654: {'auction_closing_time': 1764951917.0, 'created_time': 1764842503.54411, 'last_price_update_time': 1764929422.305981}
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY00654') HTTP/1.1" 204 0
2025-12-05 10:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ55354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC75270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS87755> (referer: https://www.auto1.com/v1/car-details-view/JS87755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2025-12-05 10:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43af84b-bc0d-5292-aff5-a40b60e24ae9 with scrape type 1
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_71062939063566b04bde60d47d53daf1.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_71062939063566b04bde60d47d53daf1.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_64cd8de1764850c9f00550a409bbedbb.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_64cd8de1764850c9f00550a409bbedbb.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_f963f93b95bb49c167018e933cf82d4b.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_f963f93b95bb49c167018e933cf82d4b.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_be024057f595d6deabbb7fcf343228cd.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_be024057f595d6deabbb7fcf343228cd.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_8d5873c074f5555d862abe134b8c3d83.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_8d5873c074f5555d862abe134b8c3d83.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_aca2c192b9cf42c20e20c8258145fd31.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_aca2c192b9cf42c20e20c8258145fd31.jpg not downloaded yet
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_5669911d43f699efe1193bf7a893e2e9.jpg%27 HTTP/1.1" 200 None
2025-12-05 10:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_5669911d43f699efe1193bf7a893e2e9.jpg not downloaded yet
2025-12-05 10:10:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.290(s), this was the 1st time calling it.
2025-12-05 10:10:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.159625119558308 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:10:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.832(s), this was the 1st time calling it.
2025-12-05 10:10:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9987661928201748 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:10:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.314(s), this was the 1st time calling it.
2025-12-05 10:10:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.544199765548523 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD13834> (referer: https://www.auto1.com/v1/car-details-view/BD13834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd with identifier: BD13834
2025-12-05 10:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd with scrape type 2
2025-12-05 10:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd with scrape type 2
2025-12-05 10:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd, identifier: BD13834
2025-12-05 10:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd with identifier: BD13834
2025-12-05 10:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd with identifier: BD13834
2025-12-05 10:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191341 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191341
2025-12-05 10:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd spider: auto1.it
2025-12-05 10:10:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd due to rule: high_mileage_for_country.json, error: 191341 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191341
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:43:52Z',
 'fuel_type': 'diesel',
 'id': '787ec5ed-ebbd-5cb8-bca5-2d77afb6b3dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD13834',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 191341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2025-12-05 10:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD13834%27 HTTP/1.1" 200 None
2025-12-05 10:10:59 [auto1.it] INFO: Saving data for BD13834: {'auction_closing_time': 1764953032.0, 'created_time': 1764842571.934032, 'last_price_update_time': 1764929459.825445}
2025-12-05 10:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD13834') HTTP/1.1" 204 0
2025-12-05 10:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_5669911d43f699efe1193bf7a893e2e9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_aca2c192b9cf42c20e20c8258145fd31.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:10:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:10:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da305d890>
2025-12-05 10:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_5669911d43f699efe1193bf7a893e2e9.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_5669911d43f699efe1193bf7a893e2e9.jpg saved to cache
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_8d5873c074f5555d862abe134b8c3d83.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da34df950>
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_aca2c192b9cf42c20e20c8258145fd31.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_aca2c192b9cf42c20e20c8258145fd31.jpg saved to cache
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da301a810>
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg saved to cache
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da301a590>
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg saved to cache
2025-12-05 10:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_be024057f595d6deabbb7fcf343228cd.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da30488d0>
2025-12-05 10:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_10.jpg HTTP/1.1" 201 0
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_8d5873c074f5555d862abe134b8c3d83.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_8d5873c074f5555d862abe134b8c3d83.jpg saved to cache
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da2f17750>
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_be024057f595d6deabbb7fcf343228cd.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_be024057f595d6deabbb7fcf343228cd.jpg saved to cache
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d17690>
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg saved to cache
2025-12-05 10:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3303a50>
2025-12-05 10:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg saved to cache
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d4e9d0>
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg saved to cache
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3021590>
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_5.jpg HTTP/1.1" 201 0
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg saved to cache
2025-12-05 10:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_f963f93b95bb49c167018e933cf82d4b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_64cd8de1764850c9f00550a409bbedbb.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3049610>
2025-12-05 10:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_f963f93b95bb49c167018e933cf82d4b.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_f963f93b95bb49c167018e933cf82d4b.jpg saved to cache
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_71062939063566b04bde60d47d53daf1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db1e79450>
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_64cd8de1764850c9f00550a409bbedbb.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_64cd8de1764850c9f00550a409bbedbb.jpg saved to cache
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3022750>
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_2.jpg HTTP/1.1" 201 0
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_71062939063566b04bde60d47d53daf1.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_71062939063566b04bde60d47d53daf1.jpg saved to cache
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3e513d0>
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_1.jpg HTTP/1.1" 201 0
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg saved to cache
2025-12-05 10:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eeab50>
2025-12-05 10:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_0.jpg HTTP/1.1" 201 0
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f34d2dde479179a104fe39574e2acf%252Fpa%252FJS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg') HTTP/1.1" 204 0
2025-12-05 10:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg saved to cache
2025-12-05 10:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d43af84b-bc0d-5292-aff5-a40b60e24ae9
2025-12-05 10:11:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d43af84b-bc0d-5292-aff5-a40b60e24ae9, skipping ID generation
2025-12-05 10:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43af84b-bc0d-5292-aff5-a40b60e24ae9 with scrape type 1
2025-12-05 10:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d43af84b-bc0d-5292-aff5-a40b60e24ae9 from tracking dictionaries
2025-12-05 10:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d43af84b-bc0d-5292-aff5-a40b60e24ae9 sending to next pipeline
2025-12-05 10:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d43af84b-bc0d-5292-aff5-a40b60e24ae9, identifier: JS87755
2025-12-05 10:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2025-12-05 10:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755
2025-12-05 10:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d43af84b-bc0d-5292-aff5-a40b60e24ae9 with identifier: JS87755 to the API
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-06T16:03:19Z',
 'fuel_type': 'petrol',
 'id': 'd43af84b-bc0d-5292-aff5-a40b60e24ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS87755',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 5137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_6b1c806c6a66eb8b8e1e8f01f0efdef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2c55acfd25972ba3253c4d1e4fcee480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_71062939063566b04bde60d47d53daf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_64cd8de1764850c9f00550a409bbedbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_f963f93b95bb49c167018e933cf82d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_83d9e0f0bd3b4ac92ba5ba56ad91bb08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2592d143e5b8e6a656b5eca795c37e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_4175bb1ee3e59108add2a8bf39a7425c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_fc9b5d8f7c82e1249982d5331c938e87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_be024057f595d6deabbb7fcf343228cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_8d5873c074f5555d862abe134b8c3d83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_2fefa01cd6a93a8aafb3c991bd579015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_9e475ddbd8ae72f46dd6cc83f6367b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_aca2c192b9cf42c20e20c8258145fd31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d43af84b-bc0d-5292-aff5-a40b60e24ae9/d43af84b-bc0d-5292-aff5-a40b60e24ae9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f34d2dde479179a104fe39574e2acf/pa/JS87755_5669911d43f699efe1193bf7a893e2e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS87755%27 HTTP/1.1" 200 None
2025-12-05 10:11:04 [auto1.it] INFO: Saving data for JS87755: {'created_time': 1764929464.875108, 'last_price_update_time': 1764929464.875117, 'auction_closing_time': 1765036999.0}
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS87755') HTTP/1.1" 204 0
2025-12-05 10:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH46646/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS60698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:17 [scrapy.extensions.logstats] INFO: Crawled 358 pages (at 7 pages/min), scraped 122 items (at 2 items/min)
2025-12-05 10:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ87382> (referer: https://www.auto1.com/v1/car-details-view/VJ87382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedfe818-1321-5925-86f1-84c9fe221a7d with identifier: VJ87382
2025-12-05 10:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedfe818-1321-5925-86f1-84c9fe221a7d with scrape type 2
2025-12-05 10:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dedfe818-1321-5925-86f1-84c9fe221a7d with scrape type 2
2025-12-05 10:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dedfe818-1321-5925-86f1-84c9fe221a7d, identifier: VJ87382
2025-12-05 10:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dedfe818-1321-5925-86f1-84c9fe221a7d with identifier: VJ87382
2025-12-05 10:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dedfe818-1321-5925-86f1-84c9fe221a7d with identifier: VJ87382
2025-12-05 10:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dedfe818-1321-5925-86f1-84c9fe221a7d with identifier: VJ87382 to the API
2025-12-05 10:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ87382>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:35:04Z',
 'fuel_type': 'diesel',
 'id': 'dedfe818-1321-5925-86f1-84c9fe221a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ87382',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 53575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2021}
2025-12-05 10:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ87382%27 HTTP/1.1" 200 None
2025-12-05 10:11:20 [auto1.it] INFO: Saving data for VJ87382: {'auction_closing_time': 1764952504.0, 'created_time': 1764842533.253873, 'last_price_update_time': 1764929480.846285}
2025-12-05 10:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ87382') HTTP/1.1" 204 0
2025-12-05 10:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:30 [auto1.it] INFO: Parsing search results for channel: 24h
2025-12-05 10:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT07045> (referer: https://www.auto1.com/v1/car-details-view/MT07045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c727da-4f43-5ff5-97d0-091792a40984 with identifier: MT07045
2025-12-05 10:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c727da-4f43-5ff5-97d0-091792a40984 with scrape type 2
2025-12-05 10:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08c727da-4f43-5ff5-97d0-091792a40984 with scrape type 2
2025-12-05 10:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08c727da-4f43-5ff5-97d0-091792a40984, identifier: MT07045
2025-12-05 10:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08c727da-4f43-5ff5-97d0-091792a40984 with identifier: MT07045
2025-12-05 10:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08c727da-4f43-5ff5-97d0-091792a40984 with identifier: MT07045
2025-12-05 10:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194106 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194106
2025-12-05 10:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 08c727da-4f43-5ff5-97d0-091792a40984 spider: auto1.it
2025-12-05 10:11:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 08c727da-4f43-5ff5-97d0-091792a40984 due to rule: high_mileage_for_country.json, error: 194106 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194106
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:26:14Z',
 'fuel_type': 'diesel',
 'id': '08c727da-4f43-5ff5-97d0-091792a40984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT07045',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 194106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2025-12-05 10:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MT07045%27 HTTP/1.1" 200 None
2025-12-05 10:11:39 [auto1.it] INFO: Saving data for MT07045: {'auction_closing_time': 1764951974.0, 'created_time': 1764842577.61214, 'last_price_update_time': 1764929499.857368}
2025-12-05 10:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MT07045') HTTP/1.1" 204 0
2025-12-05 10:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD59619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ55354> (referer: https://www.auto1.com/v1/car-details-view/VJ55354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef1757a-8f0a-5687-bd2c-a60124da6bd8 with identifier: VJ55354
2025-12-05 10:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef1757a-8f0a-5687-bd2c-a60124da6bd8 with scrape type 2
2025-12-05 10:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef1757a-8f0a-5687-bd2c-a60124da6bd8 with scrape type 2
2025-12-05 10:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eef1757a-8f0a-5687-bd2c-a60124da6bd8, identifier: VJ55354
2025-12-05 10:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eef1757a-8f0a-5687-bd2c-a60124da6bd8 with identifier: VJ55354
2025-12-05 10:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eef1757a-8f0a-5687-bd2c-a60124da6bd8 with identifier: VJ55354
2025-12-05 10:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147173 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147173
2025-12-05 10:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: eef1757a-8f0a-5687-bd2c-a60124da6bd8 spider: auto1.it
2025-12-05 10:11:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: eef1757a-8f0a-5687-bd2c-a60124da6bd8 due to rule: high_mileage_for_make.json, error: 147173 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147173
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:30:27Z',
 'fuel_type': 'diesel',
 'id': 'eef1757a-8f0a-5687-bd2c-a60124da6bd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ55354',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 147173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Business Q4',
 'transmission': 'automatic',
 'trim': 'Super Business Q4',
 'year': 2022}
2025-12-05 10:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ55354%27 HTTP/1.1" 200 None
2025-12-05 10:11:43 [auto1.it] INFO: Saving data for VJ55354: {'auction_closing_time': 1764952227.0, 'created_time': 1764014773.685786, 'last_price_update_time': 1764929503.625487}
2025-12-05 10:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ55354') HTTP/1.1" 204 0
2025-12-05 10:12:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.425(s), this was the 1st time calling it.
2025-12-05 10:12:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.104061889402371 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:12:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.149(s), this was the 2nd time calling it.
2025-12-05 10:12:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.821713126403587 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:12:17 [scrapy.extensions.logstats] INFO: Crawled 363 pages (at 5 pages/min), scraped 123 items (at 1 items/min)
2025-12-05 10:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:12:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.224(s), this was the 2nd time calling it.
2025-12-05 10:12:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.514606633529569 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX58847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR95070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR79797> (referer: https://www.auto1.com/v1/car-details-view/AR79797/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.206(s), this was the 1st time calling it.
2025-12-05 10:12:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.4999257627833895 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 622d54ae-b7da-5d36-b786-47da9f8f4541 with identifier: AR79797
2025-12-05 10:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 622d54ae-b7da-5d36-b786-47da9f8f4541 with scrape type 2
2025-12-05 10:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 622d54ae-b7da-5d36-b786-47da9f8f4541 with scrape type 2
2025-12-05 10:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 622d54ae-b7da-5d36-b786-47da9f8f4541, identifier: AR79797
2025-12-05 10:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 622d54ae-b7da-5d36-b786-47da9f8f4541 with identifier: AR79797
2025-12-05 10:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 622d54ae-b7da-5d36-b786-47da9f8f4541 with identifier: AR79797
2025-12-05 10:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 622d54ae-b7da-5d36-b786-47da9f8f4541 with identifier: AR79797 to the API
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR79797>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:01:07Z',
 'fuel_type': 'diesel',
 'id': '622d54ae-b7da-5d36-b786-47da9f8f4541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR79797',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 78595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR79797%27 HTTP/1.1" 200 None
2025-12-05 10:12:33 [auto1.it] INFO: Saving data for AR79797: {'auction_closing_time': 1764950467.0, 'created_time': 1764842560.045933, 'last_price_update_time': 1764929553.447006}
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR79797') HTTP/1.1" 204 0
2025-12-05 10:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM42492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS60698> (referer: https://www.auto1.com/v1/car-details-view/YS60698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2025-12-05 10:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7c1258-7228-5621-8263-9a7d8023e526 with scrape type 2
2025-12-05 10:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7c1258-7228-5621-8263-9a7d8023e526 with scrape type 2
2025-12-05 10:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c7c1258-7228-5621-8263-9a7d8023e526, identifier: YS60698
2025-12-05 10:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2025-12-05 10:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698
2025-12-05 10:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c7c1258-7228-5621-8263-9a7d8023e526 with identifier: YS60698 to the API
2025-12-05 10:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS60698>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2025-12-05T16:29:11Z',
 'fuel_type': 'petrol',
 'id': '7c7c1258-7228-5621-8263-9a7d8023e526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS60698',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 7680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2024}
2025-12-05 10:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2025-12-05 10:12:41 [auto1.it] INFO: Saving data for YS60698: {'auction_closing_time': 1764952151.0, 'created_time': 1764842555.669284, 'last_price_update_time': 1764929561.22397}
2025-12-05 10:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS60698') HTTP/1.1" 204 0
2025-12-05 10:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX00629/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC84957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC75270> (referer: https://www.auto1.com/v1/car-details-view/DC75270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d62f73df-4722-5ee4-889a-821e6122490e with identifier: DC75270
2025-12-05 10:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d62f73df-4722-5ee4-889a-821e6122490e with scrape type 2
2025-12-05 10:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d62f73df-4722-5ee4-889a-821e6122490e with scrape type 2
2025-12-05 10:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d62f73df-4722-5ee4-889a-821e6122490e, identifier: DC75270
2025-12-05 10:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d62f73df-4722-5ee4-889a-821e6122490e with identifier: DC75270
2025-12-05 10:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d62f73df-4722-5ee4-889a-821e6122490e with identifier: DC75270
2025-12-05 10:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d62f73df-4722-5ee4-889a-821e6122490e with identifier: DC75270 to the API
2025-12-05 10:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC75270>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2025-12-05T16:45:14Z',
 'fuel_type': 'petrol',
 'id': 'd62f73df-4722-5ee4-889a-821e6122490e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC75270',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 32433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2022}
2025-12-05 10:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC75270%27 HTTP/1.1" 200 None
2025-12-05 10:12:53 [auto1.it] INFO: Saving data for DC75270: {'auction_closing_time': 1764953114.0, 'created_time': 1764842549.600326, 'last_price_update_time': 1764929573.172863}
2025-12-05 10:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC75270') HTTP/1.1" 204 0
2025-12-05 10:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD59619> (referer: https://www.auto1.com/v1/car-details-view/XD59619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c647793a-4a83-5b86-9be6-7bd976ac8a2f with identifier: XD59619
2025-12-05 10:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c647793a-4a83-5b86-9be6-7bd976ac8a2f with scrape type 2
2025-12-05 10:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c647793a-4a83-5b86-9be6-7bd976ac8a2f with scrape type 2
2025-12-05 10:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c647793a-4a83-5b86-9be6-7bd976ac8a2f, identifier: XD59619
2025-12-05 10:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c647793a-4a83-5b86-9be6-7bd976ac8a2f with identifier: XD59619
2025-12-05 10:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c647793a-4a83-5b86-9be6-7bd976ac8a2f with identifier: XD59619
2025-12-05 10:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 197099 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197099
2025-12-05 10:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c647793a-4a83-5b86-9be6-7bd976ac8a2f spider: auto1.it
2025-12-05 10:13:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c647793a-4a83-5b86-9be6-7bd976ac8a2f due to rule: high_mileage_for_country.json, error: 197099 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197099
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:58:47Z',
 'fuel_type': 'diesel',
 'id': 'c647793a-4a83-5b86-9be6-7bd976ac8a2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD59619',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 197099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2025-12-05 10:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD59619%27 HTTP/1.1" 200 None
2025-12-05 10:13:02 [auto1.it] INFO: Saving data for XD59619: {'auction_closing_time': 1764953927.0, 'created_time': 1764446587.772845, 'last_price_update_time': 1764929582.648018}
2025-12-05 10:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD59619') HTTP/1.1" 204 0
2025-12-05 10:13:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.001(s), this was the 2nd time calling it.
2025-12-05 10:13:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.492498374107111 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:13:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.489(s), this was the 1st time calling it.
2025-12-05 10:13:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.794924136388531 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF13981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR46533/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:13:17 [scrapy.extensions.logstats] INFO: Crawled 374 pages (at 11 pages/min), scraped 126 items (at 3 items/min)
2025-12-05 10:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT83017> (referer: https://www.auto1.com/v1/car-details-view/RT83017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec491e4-4046-53e5-ba91-e0a4fc1e4c48 with identifier: RT83017
2025-12-05 10:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec491e4-4046-53e5-ba91-e0a4fc1e4c48 with scrape type 2
2025-12-05 10:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec491e4-4046-53e5-ba91-e0a4fc1e4c48 with scrape type 2
2025-12-05 10:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eec491e4-4046-53e5-ba91-e0a4fc1e4c48, identifier: RT83017
2025-12-05 10:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eec491e4-4046-53e5-ba91-e0a4fc1e4c48 with identifier: RT83017
2025-12-05 10:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eec491e4-4046-53e5-ba91-e0a4fc1e4c48 with identifier: RT83017
2025-12-05 10:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194306
2025-12-05 10:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: eec491e4-4046-53e5-ba91-e0a4fc1e4c48 spider: auto1.it
2025-12-05 10:13:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: eec491e4-4046-53e5-ba91-e0a4fc1e4c48 due to rule: high_mileage_for_country.json, error: 194306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194306
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:34:12Z',
 'fuel_type': 'diesel',
 'id': 'eec491e4-4046-53e5-ba91-e0a4fc1e4c48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT83017',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 194306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Mild-Hybrid AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2020}
2025-12-05 10:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT83017%27 HTTP/1.1" 200 None
2025-12-05 10:13:19 [auto1.it] INFO: Saving data for RT83017: {'auction_closing_time': 1764952452.0, 'created_time': 1764842525.478334, 'last_price_update_time': 1764929599.24894}
2025-12-05 10:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT83017') HTTP/1.1" 204 0
2025-12-05 10:13:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.296(s), this was the 1st time calling it.
2025-12-05 10:13:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.182251108487324 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX58847> (referer: https://www.auto1.com/v1/car-details-view/KX58847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with identifier: KX58847
2025-12-05 10:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with scrape type 2
2025-12-05 10:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with scrape type 2
2025-12-05 10:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd, identifier: KX58847
2025-12-05 10:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with identifier: KX58847
2025-12-05 10:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with identifier: KX58847
2025-12-05 10:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e11d0f8-a9e8-5e27-bdee-4f564479ebdd with identifier: KX58847 to the API
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX58847>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2025-12-05T16:23:11Z',
 'fuel_type': 'petrol',
 'id': '0e11d0f8-a9e8-5e27-bdee-4f564479ebdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX58847',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Abarth',
 'model': '595',
 'odometer': 71074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 Pista',
 'transmission': 'manual',
 'trim': 'Pista',
 'year': 2018}
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX58847%27 HTTP/1.1" 200 None
2025-12-05 10:13:23 [auto1.it] INFO: Saving data for KX58847: {'auction_closing_time': 1764951791.0, 'created_time': 1764842546.744588, 'last_price_update_time': 1764929603.592659}
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KX58847') HTTP/1.1" 204 0
2025-12-05 10:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM42492> (referer: https://www.auto1.com/v1/car-details-view/KM42492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3a8b29-fbed-518c-ae1c-bac36bc56e2c with identifier: KM42492
2025-12-05 10:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3a8b29-fbed-518c-ae1c-bac36bc56e2c with scrape type 2
2025-12-05 10:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3a8b29-fbed-518c-ae1c-bac36bc56e2c with scrape type 2
2025-12-05 10:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be3a8b29-fbed-518c-ae1c-bac36bc56e2c, identifier: KM42492
2025-12-05 10:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be3a8b29-fbed-518c-ae1c-bac36bc56e2c with identifier: KM42492
2025-12-05 10:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be3a8b29-fbed-518c-ae1c-bac36bc56e2c with identifier: KM42492
2025-12-05 10:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be3a8b29-fbed-518c-ae1c-bac36bc56e2c with identifier: KM42492 to the API
2025-12-05 10:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM42492>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2025-12-05T16:49:02Z',
 'fuel_type': 'diesel',
 'id': 'be3a8b29-fbed-518c-ae1c-bac36bc56e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM42492',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 62441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2025-12-05 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM42492%27 HTTP/1.1" 200 None
2025-12-05 10:13:25 [auto1.it] INFO: Saving data for KM42492: {'auction_closing_time': 1764953342.0, 'created_time': 1764583317.928959, 'last_price_update_time': 1764929605.055395}
2025-12-05 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM42492') HTTP/1.1" 204 0
2025-12-05 10:13:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:14:17 [scrapy.extensions.logstats] INFO: Crawled 377 pages (at 3 pages/min), scraped 128 items (at 2 items/min)
2025-12-05 10:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX08705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:14:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.760(s), this was the 1st time calling it.
2025-12-05 10:14:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.193845196604556 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:14:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.152(s), this was the 1st time calling it.
2025-12-05 10:14:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.9005688435236174 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:14:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:14:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.097(s), this was the 1st time calling it.
2025-12-05 10:14:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.713448479460986 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH46646> (referer: https://www.auto1.com/v1/car-details-view/SH46646/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8772342-8c7c-5c0a-bede-11ccc17f3624 with identifier: SH46646
2025-12-05 10:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8772342-8c7c-5c0a-bede-11ccc17f3624 with scrape type 2
2025-12-05 10:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8772342-8c7c-5c0a-bede-11ccc17f3624 with scrape type 2
2025-12-05 10:15:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8772342-8c7c-5c0a-bede-11ccc17f3624, identifier: SH46646
2025-12-05 10:15:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8772342-8c7c-5c0a-bede-11ccc17f3624 with identifier: SH46646
2025-12-05 10:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8772342-8c7c-5c0a-bede-11ccc17f3624 with identifier: SH46646
2025-12-05 10:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170139 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170139
2025-12-05 10:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a8772342-8c7c-5c0a-bede-11ccc17f3624 spider: auto1.it
2025-12-05 10:15:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a8772342-8c7c-5c0a-bede-11ccc17f3624 due to rule: high_mileage_for_country.json, error: 170139 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170139
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:33:12Z',
 'fuel_type': 'diesel',
 'id': 'a8772342-8c7c-5c0a-bede-11ccc17f3624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH46646',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': '3er',
 'odometer': 170139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2025-12-05 10:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH46646%27 HTTP/1.1" 200 None
2025-12-05 10:15:06 [auto1.it] INFO: Saving data for SH46646: {'auction_closing_time': 1764952392.0, 'created_time': 1764446438.1964, 'last_price_update_time': 1764929706.108586}
2025-12-05 10:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH46646') HTTP/1.1" 204 0
2025-12-05 10:15:17 [scrapy.extensions.logstats] INFO: Crawled 380 pages (at 3 pages/min), scraped 128 items (at 0 items/min)
2025-12-05 10:15:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.168(s), this was the 3rd time calling it.
2025-12-05 10:15:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.233430248797695 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:15:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.076(s), this was the 1st time calling it.
2025-12-05 10:15:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.423987747736885 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:15:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:15:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:15:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.731(s), this was the 1st time calling it.
2025-12-05 10:15:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.213338012555719 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE68009> (referer: https://www.auto1.com/v1/car-details-view/FE68009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4381e09-6888-55b1-9778-9172e4857090 with identifier: FE68009
2025-12-05 10:15:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4381e09-6888-55b1-9778-9172e4857090 with scrape type 2
2025-12-05 10:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4381e09-6888-55b1-9778-9172e4857090 with scrape type 2
2025-12-05 10:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4381e09-6888-55b1-9778-9172e4857090, identifier: FE68009
2025-12-05 10:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4381e09-6888-55b1-9778-9172e4857090 with identifier: FE68009
2025-12-05 10:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4381e09-6888-55b1-9778-9172e4857090 with identifier: FE68009
2025-12-05 10:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4381e09-6888-55b1-9778-9172e4857090 with identifier: FE68009 to the API
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FE68009>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:12:54Z',
 'fuel_type': 'diesel',
 'id': 'b4381e09-6888-55b1-9778-9172e4857090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE68009',
 'listing': 'auction',
 'location': "IT, Città Sant'Angelo (PE)",
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 149046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE68009%27 HTTP/1.1" 200 None
2025-12-05 10:15:36 [auto1.it] INFO: Saving data for FE68009: {'auction_closing_time': 1764951174.0, 'created_time': 1764842562.073594, 'last_price_update_time': 1764929736.283179}
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FE68009') HTTP/1.1" 204 0
2025-12-05 10:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN73607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.464(s), this was the 2nd time calling it.
2025-12-05 10:15:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.271250907172172 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:15:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX04258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR46533> (referer: https://www.auto1.com/v1/car-details-view/AR46533/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with identifier: AR46533
2025-12-05 10:15:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with scrape type 2
2025-12-05 10:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with scrape type 2
2025-12-05 10:15:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71ae49f6-7a91-5df3-855a-c7c773ec4c24, identifier: AR46533
2025-12-05 10:15:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with identifier: AR46533
2025-12-05 10:15:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with identifier: AR46533
2025-12-05 10:15:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71ae49f6-7a91-5df3-855a-c7c773ec4c24 with identifier: AR46533 to the API
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:15:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR46533>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'expiration_date': '2025-12-05T16:55:10Z',
 'fuel_type': 'hybrid',
 'id': '71ae49f6-7a91-5df3-855a-c7c773ec4c24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR46533',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 44399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 Hybrid XTech+ 2WD',
 'transmission': 'automatic',
 'trim': 'XTech+ 2WD',
 'year': 2023}
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR46533%27 HTTP/1.1" 200 None
2025-12-05 10:15:49 [auto1.it] INFO: Saving data for AR46533: {'auction_closing_time': 1764953710.0, 'created_time': 1764842572.440227, 'last_price_update_time': 1764929749.835161}
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR46533') HTTP/1.1" 204 0
2025-12-05 10:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR95070> (referer: https://www.auto1.com/v1/car-details-view/CR95070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:15:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85decd9a-69f9-56ae-bfbb-c1665bce633c with identifier: CR95070
2025-12-05 10:15:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85decd9a-69f9-56ae-bfbb-c1665bce633c with scrape type 2
2025-12-05 10:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85decd9a-69f9-56ae-bfbb-c1665bce633c with scrape type 2
2025-12-05 10:15:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85decd9a-69f9-56ae-bfbb-c1665bce633c, identifier: CR95070
2025-12-05 10:15:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85decd9a-69f9-56ae-bfbb-c1665bce633c with identifier: CR95070
2025-12-05 10:15:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85decd9a-69f9-56ae-bfbb-c1665bce633c with identifier: CR95070
2025-12-05 10:15:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85decd9a-69f9-56ae-bfbb-c1665bce633c with identifier: CR95070 to the API
2025-12-05 10:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:15:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:15:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR95070>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 333,
 'expiration_date': '2025-12-05T16:54:33Z',
 'fuel_type': 'petrol',
 'id': '85decd9a-69f9-56ae-bfbb-c1665bce633c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR95070',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 58664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive 40i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2025-12-05 10:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR95070%27 HTTP/1.1" 200 None
2025-12-05 10:15:51 [auto1.it] INFO: Saving data for CR95070: {'auction_closing_time': 1764953673.0, 'created_time': 1764446443.903277, 'last_price_update_time': 1764929751.828039}
2025-12-05 10:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR95070') HTTP/1.1" 204 0
2025-12-05 10:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS29601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH36098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:16:17 [scrapy.extensions.logstats] INFO: Crawled 387 pages (at 7 pages/min), scraped 131 items (at 3 items/min)
2025-12-05 10:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX08705> (referer: https://www.auto1.com/v1/car-details-view/UX08705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43eba053-3d47-5c61-b336-df3c4b33f0f1 with identifier: UX08705
2025-12-05 10:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43eba053-3d47-5c61-b336-df3c4b33f0f1 with scrape type 2
2025-12-05 10:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43eba053-3d47-5c61-b336-df3c4b33f0f1 with scrape type 2
2025-12-05 10:16:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43eba053-3d47-5c61-b336-df3c4b33f0f1, identifier: UX08705
2025-12-05 10:16:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43eba053-3d47-5c61-b336-df3c4b33f0f1 with identifier: UX08705
2025-12-05 10:16:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43eba053-3d47-5c61-b336-df3c4b33f0f1 with identifier: UX08705
2025-12-05 10:16:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43eba053-3d47-5c61-b336-df3c4b33f0f1 with identifier: UX08705 to the API
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UX08705>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:05:33Z',
 'fuel_type': 'diesel',
 'id': '43eba053-3d47-5c61-b336-df3c4b33f0f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX08705',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 82372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX08705%27 HTTP/1.1" 200 None
2025-12-05 10:16:29 [auto1.it] INFO: Saving data for UX08705: {'auction_closing_time': 1764950733.0, 'created_time': 1764446529.859269, 'last_price_update_time': 1764929789.357764}
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX08705') HTTP/1.1" 204 0
2025-12-05 10:16:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.872(s), this was the 1st time calling it.
2025-12-05 10:16:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.000238956113003 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF13981> (referer: https://www.auto1.com/v1/car-details-view/XF13981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa6b3aef-17e5-5201-9912-926cea58fbb0 with identifier: XF13981
2025-12-05 10:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa6b3aef-17e5-5201-9912-926cea58fbb0 with scrape type 2
2025-12-05 10:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa6b3aef-17e5-5201-9912-926cea58fbb0 with scrape type 2
2025-12-05 10:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa6b3aef-17e5-5201-9912-926cea58fbb0, identifier: XF13981
2025-12-05 10:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa6b3aef-17e5-5201-9912-926cea58fbb0 with identifier: XF13981
2025-12-05 10:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa6b3aef-17e5-5201-9912-926cea58fbb0 with identifier: XF13981
2025-12-05 10:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa6b3aef-17e5-5201-9912-926cea58fbb0 with identifier: XF13981 to the API
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XF13981>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:07:04Z',
 'fuel_type': 'diesel',
 'id': 'fa6b3aef-17e5-5201-9912-926cea58fbb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF13981',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'BMW',
 'model': '3er',
 'odometer': 109967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d GT xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2017}
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF13981%27 HTTP/1.1" 200 None
2025-12-05 10:16:44 [auto1.it] INFO: Saving data for XF13981: {'auction_closing_time': 1764950824.0, 'created_time': 1761163249.232487, 'last_price_update_time': 1764929804.544105}
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF13981') HTTP/1.1" 204 0
2025-12-05 10:16:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.924(s), this was the 2nd time calling it.
2025-12-05 10:16:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.799295223435523 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:16:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX00629> (referer: https://www.auto1.com/v1/car-details-view/CX00629/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060d7754-e416-5524-aea4-89a5830c3cdc with identifier: CX00629
2025-12-05 10:17:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060d7754-e416-5524-aea4-89a5830c3cdc with scrape type 2
2025-12-05 10:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 060d7754-e416-5524-aea4-89a5830c3cdc with scrape type 2
2025-12-05 10:17:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 060d7754-e416-5524-aea4-89a5830c3cdc, identifier: CX00629
2025-12-05 10:17:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 060d7754-e416-5524-aea4-89a5830c3cdc with identifier: CX00629
2025-12-05 10:17:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 060d7754-e416-5524-aea4-89a5830c3cdc with identifier: CX00629
2025-12-05 10:17:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 060d7754-e416-5524-aea4-89a5830c3cdc with identifier: CX00629 to the API
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:17:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX00629>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:01:25Z',
 'fuel_type': 'petrol',
 'id': '060d7754-e416-5524-aea4-89a5830c3cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX00629',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 84793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX00629%27 HTTP/1.1" 200 None
2025-12-05 10:17:01 [auto1.it] INFO: Saving data for CX00629: {'auction_closing_time': 1764950485.0, 'created_time': 1764842559.728041, 'last_price_update_time': 1764929821.343372}
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CX00629') HTTP/1.1" 204 0
2025-12-05 10:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ25760> (referer: https://www.auto1.com/v1/car-details-view/LZ25760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e435ae8d-ec64-57d4-8be9-9d8c759dae4d with identifier: LZ25760
2025-12-05 10:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e435ae8d-ec64-57d4-8be9-9d8c759dae4d with scrape type 2
2025-12-05 10:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e435ae8d-ec64-57d4-8be9-9d8c759dae4d with scrape type 2
2025-12-05 10:17:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e435ae8d-ec64-57d4-8be9-9d8c759dae4d, identifier: LZ25760
2025-12-05 10:17:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e435ae8d-ec64-57d4-8be9-9d8c759dae4d with identifier: LZ25760
2025-12-05 10:17:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e435ae8d-ec64-57d4-8be9-9d8c759dae4d with identifier: LZ25760
2025-12-05 10:17:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e435ae8d-ec64-57d4-8be9-9d8c759dae4d with identifier: LZ25760 to the API
2025-12-05 10:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:17:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ25760>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2025-12-05T16:18:55Z',
 'fuel_type': 'hybrid',
 'id': 'e435ae8d-ec64-57d4-8be9-9d8c759dae4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ25760',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': '5er',
 'odometer': 86535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2025-12-05 10:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2025-12-05 10:17:06 [auto1.it] INFO: Saving data for LZ25760: {'auction_closing_time': 1764951535.0, 'created_time': 1764842569.446756, 'last_price_update_time': 1764929826.917262}
2025-12-05 10:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ25760') HTTP/1.1" 204 0
2025-12-05 10:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU51578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.007(s), this was the 1st time calling it.
2025-12-05 10:17:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6549631320405362 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:17:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX04258> (referer: https://www.auto1.com/v1/car-details-view/DX04258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with identifier: DX04258
2025-12-05 10:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with scrape type 2
2025-12-05 10:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with scrape type 2
2025-12-05 10:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b, identifier: DX04258
2025-12-05 10:17:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with identifier: DX04258
2025-12-05 10:17:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with identifier: DX04258
2025-12-05 10:17:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b with identifier: DX04258 to the API
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:17:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX04258>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2025-12-05T16:50:24Z',
 'fuel_type': 'petrol',
 'id': '79fb6b61-79bf-5b13-a3b6-21e9fc6f0e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX04258',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 5256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2024}
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX04258%27 HTTP/1.1" 200 None
2025-12-05 10:17:08 [auto1.it] INFO: Saving data for DX04258: {'auction_closing_time': 1764953424.0, 'created_time': 1761120171.005344, 'last_price_update_time': 1764929828.94467}
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX04258') HTTP/1.1" 204 0
2025-12-05 10:17:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC84957> (referer: https://www.auto1.com/v1/car-details-view/WC84957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d74b460-32c7-5c6e-bfff-cf62919453ac with identifier: WC84957
2025-12-05 10:17:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d74b460-32c7-5c6e-bfff-cf62919453ac with scrape type 2
2025-12-05 10:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d74b460-32c7-5c6e-bfff-cf62919453ac with scrape type 2
2025-12-05 10:17:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d74b460-32c7-5c6e-bfff-cf62919453ac, identifier: WC84957
2025-12-05 10:17:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d74b460-32c7-5c6e-bfff-cf62919453ac with identifier: WC84957
2025-12-05 10:17:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d74b460-32c7-5c6e-bfff-cf62919453ac with identifier: WC84957
2025-12-05 10:17:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d74b460-32c7-5c6e-bfff-cf62919453ac with identifier: WC84957 to the API
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC84957>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-05T16:34:34Z',
 'fuel_type': 'petrol',
 'id': '9d74b460-32c7-5c6e-bfff-cf62919453ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC84957',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 74603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC84957%27 HTTP/1.1" 200 None
2025-12-05 10:17:13 [auto1.it] INFO: Saving data for WC84957: {'auction_closing_time': 1764952474.0, 'created_time': 1762459392.478366, 'last_price_update_time': 1764929833.44087}
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC84957') HTTP/1.1" 204 0
2025-12-05 10:17:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.999(s), this was the 1st time calling it.
2025-12-05 10:17:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.604711451871826 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:17:17 [scrapy.extensions.logstats] INFO: Crawled 394 pages (at 7 pages/min), scraped 137 items (at 6 items/min)
2025-12-05 10:17:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX41333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP05731/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH36098> (referer: https://www.auto1.com/v1/car-details-view/YH36098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:17:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:17:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2025-12-05 10:17:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc55a665-c512-574c-8eac-d633b455321d with scrape type 2
2025-12-05 10:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc55a665-c512-574c-8eac-d633b455321d with scrape type 2
2025-12-05 10:17:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc55a665-c512-574c-8eac-d633b455321d, identifier: YH36098
2025-12-05 10:17:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2025-12-05 10:17:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2025-12-05 10:17:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098 to the API
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:17:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH36098>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.3L',
 'engine_horse_power': 102,
 'expiration_date': '2025-12-05T16:16:23Z',
 'fuel_type': 'petrol',
 'id': 'bc55a665-c512-574c-8eac-d633b455321d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH36098',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 40322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2025-12-05 10:17:51 [auto1.it] INFO: Saving data for YH36098: {'auction_closing_time': 1764951383.0, 'created_time': 1764842485.086207, 'last_price_update_time': 1764929871.435539}
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH36098') HTTP/1.1" 204 0
2025-12-05 10:17:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.680(s), this was the 3rd time calling it.
2025-12-05 10:17:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 9.202328276049144 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:17:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.950(s), this was the 1st time calling it.
2025-12-05 10:17:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.42748266711112 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:18:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:18:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:18:17 [scrapy.extensions.logstats] INFO: Crawled 397 pages (at 3 pages/min), scraped 138 items (at 1 items/min)
2025-12-05 10:19:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.092(s), this was the 3rd time calling it.
2025-12-05 10:19:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.169658577180067 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:19:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.927(s), this was the 1st time calling it.
2025-12-05 10:19:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7851688859722454 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:19:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:19:17 [scrapy.extensions.logstats] INFO: Crawled 397 pages (at 0 pages/min), scraped 138 items (at 0 items/min)
2025-12-05 10:19:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:19:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.719(s), this was the 1st time calling it.
2025-12-05 10:19:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.064839300739907 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:19:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:19:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.163(s), this was the 2nd time calling it.
2025-12-05 10:19:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.463344852238957 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:19:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN73607> (referer: https://www.auto1.com/v1/car-details-view/VN73607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:19:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:19:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7c7009-3828-5719-889b-7f31855d7c86 with identifier: VN73607
2025-12-05 10:19:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7c7009-3828-5719-889b-7f31855d7c86 with scrape type 2
2025-12-05 10:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7c7009-3828-5719-889b-7f31855d7c86 with scrape type 2
2025-12-05 10:19:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b7c7009-3828-5719-889b-7f31855d7c86, identifier: VN73607
2025-12-05 10:19:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b7c7009-3828-5719-889b-7f31855d7c86 with identifier: VN73607
2025-12-05 10:19:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b7c7009-3828-5719-889b-7f31855d7c86 with identifier: VN73607
2025-12-05 10:19:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b7c7009-3828-5719-889b-7f31855d7c86 with identifier: VN73607 to the API
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:19:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN73607>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:38:25Z',
 'fuel_type': 'diesel',
 'id': '7b7c7009-3828-5719-889b-7f31855d7c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN73607',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 115201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2018}
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN73607%27 HTTP/1.1" 200 None
2025-12-05 10:19:51 [auto1.it] INFO: Saving data for VN73607: {'auction_closing_time': 1764952705.0, 'created_time': 1764842571.636556, 'last_price_update_time': 1764929991.511188}
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN73607') HTTP/1.1" 204 0
2025-12-05 10:19:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.035(s), this was the 1st time calling it.
2025-12-05 10:19:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.973076075174471 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:20:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.599(s), this was the 1st time calling it.
2025-12-05 10:20:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.4449140155744615 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:20:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:20:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN56520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:20:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK03588/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:20:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:20:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.114(s), this was the 2nd time calling it.
2025-12-05 10:20:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.917240877450553 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:20:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 540.944(s), this was the 4th time calling it.
2025-12-05 10:20:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.155289938737928 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:20:17 [scrapy.extensions.logstats] INFO: Crawled 400 pages (at 3 pages/min), scraped 139 items (at 1 items/min)
2025-12-05 10:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:20:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB24142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:20:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE54104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:20:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:21:17 [scrapy.extensions.logstats] INFO: Crawled 402 pages (at 2 pages/min), scraped 139 items (at 0 items/min)
2025-12-05 10:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF55031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:21:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:21:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 536.264(s), this was the 4th time calling it.
2025-12-05 10:21:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 10.709913483572622 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:21:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:21:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.887(s), this was the 2nd time calling it.
2025-12-05 10:21:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.135835953211675 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:21:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD94632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:21:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:21:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:21:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH55073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:21:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX41333> (referer: https://www.auto1.com/v1/car-details-view/TX41333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:21:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:21:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with identifier: TX41333
2025-12-05 10:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with scrape type 2
2025-12-05 10:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with scrape type 2
2025-12-05 10:21:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f4b6e41-2aa7-5b0c-a111-9817ec73c895, identifier: TX41333
2025-12-05 10:21:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with identifier: TX41333
2025-12-05 10:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with identifier: TX41333
2025-12-05 10:21:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f4b6e41-2aa7-5b0c-a111-9817ec73c895 with identifier: TX41333 to the API
2025-12-05 10:21:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:21:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:21:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX41333>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:00:44Z',
 'fuel_type': 'diesel',
 'id': '4f4b6e41-2aa7-5b0c-a111-9817ec73c895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX41333',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 125469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2025-12-05 10:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX41333%27 HTTP/1.1" 200 None
2025-12-05 10:21:49 [auto1.it] INFO: Saving data for TX41333: {'auction_closing_time': 1764950444.0, 'created_time': 1764446564.832147, 'last_price_update_time': 1764930109.483148}
2025-12-05 10:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TX41333') HTTP/1.1" 204 0
2025-12-05 10:22:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.334(s), this was the 1st time calling it.
2025-12-05 10:22:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.645704563443299 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:22:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP05731> (referer: https://www.auto1.com/v1/car-details-view/KP05731/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:22:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:22:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5577e8c7-3e60-50a0-9195-a12c06aac578 with identifier: KP05731
2025-12-05 10:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5577e8c7-3e60-50a0-9195-a12c06aac578 with scrape type 2
2025-12-05 10:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5577e8c7-3e60-50a0-9195-a12c06aac578 with scrape type 2
2025-12-05 10:22:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5577e8c7-3e60-50a0-9195-a12c06aac578, identifier: KP05731
2025-12-05 10:22:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5577e8c7-3e60-50a0-9195-a12c06aac578 with identifier: KP05731
2025-12-05 10:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5577e8c7-3e60-50a0-9195-a12c06aac578 with identifier: KP05731
2025-12-05 10:22:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5577e8c7-3e60-50a0-9195-a12c06aac578 with identifier: KP05731 to the API
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:22:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP05731>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-05T16:38:39Z',
 'fuel_type': 'diesel',
 'id': '5577e8c7-3e60-50a0-9195-a12c06aac578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP05731',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 76188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP05731%27 HTTP/1.1" 200 None
2025-12-05 10:22:04 [auto1.it] INFO: Saving data for KP05731: {'auction_closing_time': 1764952719.0, 'created_time': 1764842577.953314, 'last_price_update_time': 1764930124.392209}
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KP05731') HTTP/1.1" 204 0
2025-12-05 10:22:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:22:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.247(s), this was the 2nd time calling it.
2025-12-05 10:22:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.180197517878787 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:22:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:22:17 [scrapy.extensions.logstats] INFO: Crawled 407 pages (at 5 pages/min), scraped 141 items (at 2 items/min)
2025-12-05 10:22:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.330(s), this was the 3rd time calling it.
2025-12-05 10:22:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.138289170645067 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:22:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.818(s), this was the 1st time calling it.
2025-12-05 10:22:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.287610504809432 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:22:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:22:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:22:53 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.960(s), this was the 1st time calling it.
2025-12-05 10:22:53 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.9815226378608 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP57818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:22:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:23:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:23:17 [scrapy.extensions.logstats] INFO: Crawled 408 pages (at 1 pages/min), scraped 141 items (at 0 items/min)
2025-12-05 10:23:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.321(s), this was the 1st time calling it.
2025-12-05 10:23:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.110679311414051 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:23:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:24:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.510(s), this was the 1st time calling it.
2025-12-05 10:24:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.515039528713862 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:24:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:24:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.546(s), this was the 2nd time calling it.
2025-12-05 10:24:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.245327581239051 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:24:17 [scrapy.extensions.logstats] INFO: Crawled 408 pages (at 0 pages/min), scraped 141 items (at 0 items/min)
2025-12-05 10:24:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:24:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.415(s), this was the 3rd time calling it.
2025-12-05 10:24:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.555493885600924 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:24:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:24:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.986(s), this was the 2nd time calling it.
2025-12-05 10:24:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.573925170930059 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:24:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.549(s), this was the 4th time calling it.
2025-12-05 10:24:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.983609041687563 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:24:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:24:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:25:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.855(s), this was the 1st time calling it.
2025-12-05 10:25:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.758266028585702 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:25:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.176(s), this was the 2nd time calling it.
2025-12-05 10:25:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.9183983204406 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:25:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:25:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:25:17 [scrapy.extensions.logstats] INFO: Crawled 408 pages (at 0 pages/min), scraped 141 items (at 0 items/min)
2025-12-05 10:25:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.541(s), this was the 2nd time calling it.
2025-12-05 10:25:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.957221548477399 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:25:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:26:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU51578> (referer: https://www.auto1.com/v1/car-details-view/SU51578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:26:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:26:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7eabed2-3db9-5752-b79e-51786d2ed413 with identifier: SU51578
2025-12-05 10:26:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7eabed2-3db9-5752-b79e-51786d2ed413 with scrape type 2
2025-12-05 10:26:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7eabed2-3db9-5752-b79e-51786d2ed413 with scrape type 2
2025-12-05 10:26:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7eabed2-3db9-5752-b79e-51786d2ed413, identifier: SU51578
2025-12-05 10:26:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7eabed2-3db9-5752-b79e-51786d2ed413 with identifier: SU51578
2025-12-05 10:26:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7eabed2-3db9-5752-b79e-51786d2ed413 with identifier: SU51578
2025-12-05 10:26:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7eabed2-3db9-5752-b79e-51786d2ed413 with identifier: SU51578 to the API
2025-12-05 10:26:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:26:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:26:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU51578>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2025-12-05T16:27:26Z',
 'fuel_type': 'diesel',
 'id': 'b7eabed2-3db9-5752-b79e-51786d2ed413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU51578',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 58896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2025-12-05 10:26:01 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2025-12-05 10:26:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU51578%27 HTTP/1.1" 200 None
2025-12-05 10:26:02 [auto1.it] INFO: Saving data for SU51578: {'auction_closing_time': 1764952046.0, 'created_time': 1764446578.134445, 'last_price_update_time': 1764930362.033343}
2025-12-05 10:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:26:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU51578') HTTP/1.1" 204 0
2025-12-05 10:26:17 [scrapy.extensions.logstats] INFO: Crawled 409 pages (at 1 pages/min), scraped 142 items (at 1 items/min)
2025-12-05 10:26:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 262.630(s), this was the 2nd time calling it.
2025-12-05 10:26:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.47731221741973 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:26:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:26:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 403.762(s), this was the 3rd time calling it.
2025-12-05 10:26:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.337793603890704 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:26:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:26:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.631(s), this was the 4th time calling it.
2025-12-05 10:26:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 11.696015419341688 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:26:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:27:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 676.762(s), this was the 5th time calling it.
2025-12-05 10:27:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 13.482917224286632 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:27:17 [scrapy.extensions.logstats] INFO: Crawled 409 pages (at 0 pages/min), scraped 142 items (at 0 items/min)
2025-12-05 10:27:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:27:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.071(s), this was the 2nd time calling it.
2025-12-05 10:27:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.62650912228117 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:27:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 403.345(s), this was the 3rd time calling it.
2025-12-05 10:27:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.325648227141654 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:27:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN56520> (referer: https://www.auto1.com/v1/car-details-view/BN56520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:27:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:27:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30249a9a-9449-554f-b8dd-56fd1ef575f5 with identifier: BN56520
2025-12-05 10:27:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30249a9a-9449-554f-b8dd-56fd1ef575f5 with scrape type 2
2025-12-05 10:27:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30249a9a-9449-554f-b8dd-56fd1ef575f5 with scrape type 2
2025-12-05 10:27:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30249a9a-9449-554f-b8dd-56fd1ef575f5, identifier: BN56520
2025-12-05 10:27:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30249a9a-9449-554f-b8dd-56fd1ef575f5 with identifier: BN56520
2025-12-05 10:27:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30249a9a-9449-554f-b8dd-56fd1ef575f5 with identifier: BN56520
2025-12-05 10:27:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30249a9a-9449-554f-b8dd-56fd1ef575f5 with identifier: BN56520 to the API
2025-12-05 10:27:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:27:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:27:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BN56520>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 165,
 'expiration_date': '2025-12-05T16:25:39Z',
 'fuel_type': 'petrol',
 'id': '30249a9a-9449-554f-b8dd-56fd1ef575f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN56520',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Abarth',
 'model': '595',
 'odometer': 34722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Pista',
 'transmission': 'manual',
 'trim': 'Pista',
 'year': 2020}
2025-12-05 10:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN56520%27 HTTP/1.1" 200 None
2025-12-05 10:27:32 [auto1.it] INFO: Saving data for BN56520: {'auction_closing_time': 1764951939.0, 'created_time': 1764446470.736895, 'last_price_update_time': 1764930452.16587}
2025-12-05 10:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN56520') HTTP/1.1" 204 0
2025-12-05 10:27:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:28:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 404.753(s), this was the 3rd time calling it.
2025-12-05 10:28:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.704652178863974 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:28:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:28:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.660(s), this was the 1st time calling it.
2025-12-05 10:28:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.026035202958715 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:28:17 [scrapy.extensions.logstats] INFO: Crawled 410 pages (at 1 pages/min), scraped 143 items (at 1 items/min)
2025-12-05 10:28:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:28:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 399.846(s), this was the 3rd time calling it.
2025-12-05 10:28:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.752455667334553 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:28:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:28:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 540.978(s), this was the 4th time calling it.
2025-12-05 10:28:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.340890541118952 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:29:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:29:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 680.943(s), this was the 5th time calling it.
2025-12-05 10:29:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 13.854972354030684 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:29:17 [scrapy.extensions.logstats] INFO: Crawled 410 pages (at 0 pages/min), scraped 143 items (at 0 items/min)
2025-12-05 10:29:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:29:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 820.122(s), this was the 6th time calling it.
2025-12-05 10:29:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 18.78316157810645 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:29:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.445(s), this was the 1st time calling it.
2025-12-05 10:29:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.602007730055841 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:29:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 540.560(s), this was the 4th time calling it.
2025-12-05 10:29:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.681038379830125 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:29:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:29:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 7th time calling it.
2025-12-05 10:29:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:30:17 [scrapy.extensions.logstats] INFO: Crawled 410 pages (at 0 pages/min), scraped 143 items (at 0 items/min)
2025-12-05 10:30:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 539.921(s), this was the 4th time calling it.
2025-12-05 10:30:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6709044101030943 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:30:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.876(s), this was the 2nd time calling it.
2025-12-05 10:30:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.791128710739012 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:30:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:30:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 535.014(s), this was the 4th time calling it.
2025-12-05 10:30:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.8827259374545 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:31:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 680.242(s), this was the 5th time calling it.
2025-12-05 10:31:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 13.2341135472344 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:31:17 [scrapy.extensions.logstats] INFO: Crawled 410 pages (at 0 pages/min), scraped 143 items (at 0 items/min)
2025-12-05 10:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH40683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE54104> (referer: https://www.auto1.com/v1/car-details-view/BE54104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:31:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2025-12-05 10:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with scrape type 2
2025-12-05 10:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with scrape type 2
2025-12-05 10:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d, identifier: BE54104
2025-12-05 10:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2025-12-05 10:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2025-12-05 10:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104 to the API
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE54104>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-05T16:40:12Z',
 'fuel_type': 'petrol',
 'id': '4be2cfc5-1f46-522c-a0da-349bd35d3f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE54104',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 7067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Summit',
 'transmission': 'manual',
 'trim': 'Summit',
 'year': 2024}
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2025-12-05 10:31:26 [auto1.it] INFO: Saving data for BE54104: {'auction_closing_time': 1764952812.0, 'created_time': 1764446591.049842, 'last_price_update_time': 1764930686.953274}
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE54104') HTTP/1.1" 204 0
2025-12-05 10:31:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 824.307(s), this was the 6th time calling it.
2025-12-05 10:31:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 29.08111684862466 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:31:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.613(s), this was the 2nd time calling it.
2025-12-05 10:31:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.853451457232788 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:31:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 969.626(s), this was the 7th time calling it.
2025-12-05 10:31:58 [scrapy_zyte_api.handler] DEBUG: Got an error when processing Zyte API request (https://www.auto1.com/v1/car-details-view/SC05973/cdb8adcc-312b-4040-b112-4a289f3f9b07): Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)]
2025-12-05 10:31:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 675.728(s), this was the 5th time calling it.
2025-12-05 10:31:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 17.775872698113577 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:31:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://www.auto1.com/v1/car-details-view/SC05973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (failed 1 times): Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)]
2025-12-05 10:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 7th time calling it.
2025-12-05 10:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS29601> (referer: https://www.auto1.com/v1/car-details-view/TS29601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with identifier: TS29601
2025-12-05 10:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with scrape type 2
2025-12-05 10:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with scrape type 2
2025-12-05 10:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1, identifier: TS29601
2025-12-05 10:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with identifier: TS29601
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2025-12-05 10:32:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-05 10:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with identifier: TS29601
2025-12-05 10:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01ddf8fb-134b-51b1-a33b-0ddc578e0ca1 with identifier: TS29601 to the API
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS29601>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 228,
 'expiration_date': '2025-12-05T16:15:02Z',
 'fuel_type': 'electro',
 'id': '01ddf8fb-134b-51b1-a33b-0ddc578e0ca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS29601',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'EQB',
 'odometer': 30644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQB 300 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS29601%27 HTTP/1.1" 200 None
2025-12-05 10:32:03 [auto1.it] INFO: Saving data for TS29601: {'auction_closing_time': 1764951302.0, 'created_time': 1764842568.479011, 'last_price_update_time': 1764930723.713763}
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TS29601') HTTP/1.1" 204 0
2025-12-05 10:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB24142> (referer: https://www.auto1.com/v1/car-details-view/UB24142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with identifier: UB24142
2025-12-05 10:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with scrape type 2
2025-12-05 10:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with scrape type 2
2025-12-05 10:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f406cf6a-c7e2-5ceb-9767-67c2a330ca39, identifier: UB24142
2025-12-05 10:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with identifier: UB24142
2025-12-05 10:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with identifier: UB24142
2025-12-05 10:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f406cf6a-c7e2-5ceb-9767-67c2a330ca39 with identifier: UB24142 to the API
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UB24142>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2025-12-05T16:06:15Z',
 'fuel_type': 'hybrid',
 'id': 'f406cf6a-c7e2-5ceb-9767-67c2a330ca39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB24142',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Lexus',
 'model': 'UX-Serie',
 'odometer': 80242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus UX-Serie UX 250h Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2020}
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB24142%27 HTTP/1.1" 200 None
2025-12-05 10:32:06 [auto1.it] INFO: Saving data for UB24142: {'auction_closing_time': 1764950775.0, 'created_time': 1764842498.412071, 'last_price_update_time': 1764930726.35899}
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB24142') HTTP/1.1" 204 0
2025-12-05 10:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:32:17 [scrapy.extensions.logstats] INFO: Crawled 414 pages (at 4 pages/min), scraped 146 items (at 3 items/min)
2025-12-05 10:32:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 673.041(s), this was the 5th time calling it.
2025-12-05 10:32:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 12.881191902566167 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:32:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:32:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 404.092(s), this was the 3rd time calling it.
2025-12-05 10:32:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.579780652074829 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2025-12-05 10:33:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 670.182(s), this was the 5th time calling it.
2025-12-05 10:33:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 16.25058799602355 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:33:17 [scrapy.extensions.logstats] INFO: Crawled 414 pages (at 0 pages/min), scraped 146 items (at 0 items/min)
2025-12-05 10:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 6th time calling it.
2025-12-05 10:33:36 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.315(s), this was the 1st time calling it.
2025-12-05 10:33:36 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.188290047678796 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:34:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.074(s), this was the 1st time calling it.
2025-12-05 10:34:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.909319070742094 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:34:13 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.553(s), this was the 1st time calling it.
2025-12-05 10:34:13 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.92341475687759 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:34:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.661(s), this was the 1st time calling it.
2025-12-05 10:34:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.683078317383659 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:34:17 [scrapy.extensions.logstats] INFO: Crawled 414 pages (at 0 pages/min), scraped 146 items (at 0 items/min)
2025-12-05 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF55031> (referer: https://www.auto1.com/v1/car-details-view/PF55031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with identifier: PF55031
2025-12-05 10:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with scrape type 2
2025-12-05 10:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with scrape type 2
2025-12-05 10:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2, identifier: PF55031
2025-12-05 10:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with identifier: PF55031
2025-12-05 10:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with identifier: PF55031
2025-12-05 10:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2 with identifier: PF55031 to the API
2025-12-05 10:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF55031>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:32:23Z',
 'fuel_type': 'diesel',
 'id': '0f90b102-fd6a-5dc4-8a0d-95b9e1405aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF55031',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 89288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 2.0 M-Jet City Cross',
 'transmission': 'automatic',
 'trim': 'City Cross',
 'year': 2019}
2025-12-05 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF55031%27 HTTP/1.1" 200 None
2025-12-05 10:34:19 [auto1.it] INFO: Saving data for PF55031: {'auction_closing_time': 1764952343.0, 'created_time': 1762286717.994758, 'last_price_update_time': 1764930859.052422}
2025-12-05 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF55031') HTTP/1.1" 204 0
2025-12-05 10:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:34:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 823.184(s), this was the 6th time calling it.
2025-12-05 10:34:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 28.45017829802042 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM46958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:34:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 7th time calling it.
2025-12-05 10:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 816.401(s), this was the 6th time calling it.
2025-12-05 10:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 13.441878015940683 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH90153/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 541.308(s), this was the 4th time calling it.
2025-12-05 10:35:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 11.563613962590406 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:35:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC72396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 7th time calling it.
2025-12-05 10:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY09053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP57818> (referer: https://www.auto1.com/v1/car-details-view/YP57818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2025-12-05 10:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with scrape type 2
2025-12-05 10:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with scrape type 2
2025-12-05 10:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b430618-12a2-5ef9-b8cf-158756d3a6f4, identifier: YP57818
2025-12-05 10:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2025-12-05 10:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2025-12-05 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 3.0 v6 diesel gransport', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 127947, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818', 'expiration_date': '2025-12-05t16:25:30z', 'origin_country_code': 'it', 'trim': 'gransport', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 250, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 213, 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4', 'current_year_diff': 7, 'age_in_months': 85, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 127947}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 213,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '3.0l',
     'engine_horse_power': 250,
     'expiration_date': '2025-12-05t16:25:30z',
     'fuel_type': 'diesel',
     'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818',
     'listing': 'auction',
     'location': 'it, bentivoglio (bo)',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 127947,
     'odometer_in_km': 127947,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-11',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 3.0 v6 diesel gransport',
     'transmission': 'automatic',
     'trim': 'gransport',
     'year': 2018}
2025-12-05 10:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 spider: auto1.it
2025-12-05 10:35:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 3.0 v6 diesel gransport', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 127947, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818', 'expiration_date': '2025-12-05t16:25:30z', 'origin_country_code': 'it', 'trim': 'gransport', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 250, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 213, 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4', 'current_year_diff': 7, 'age_in_months': 85, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 127947}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 213,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '3.0l',
     'engine_horse_power': 250,
     'expiration_date': '2025-12-05t16:25:30z',
     'fuel_type': 'diesel',
     'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818',
     'listing': 'auction',
     'location': 'it, bentivoglio (bo)',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 127947,
     'odometer_in_km': 127947,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-11',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 3.0 v6 diesel gransport',
     'transmission': 'automatic',
     'trim': 'gransport',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '3.0L',
 'engine_horse_power': 250,
 'expiration_date': '2025-12-05T16:25:30Z',
 'fuel_type': 'diesel',
 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP57818',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 127947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranSport',
 'transmission': 'automatic',
 'trim': 'GranSport',
 'year': 2018}
2025-12-05 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2025-12-05 10:35:13 [auto1.it] INFO: Saving data for YP57818: {'auction_closing_time': 1764951930.0, 'created_time': 1764446444.569635, 'last_price_update_time': 1764930913.205613}
2025-12-05 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP57818') HTTP/1.1" 204 0
2025-12-05 10:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 5th time calling it.
2025-12-05 10:35:17 [scrapy.extensions.logstats] INFO: Crawled 420 pages (at 6 pages/min), scraped 147 items (at 1 items/min)
2025-12-05 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK03588> (referer: https://www.auto1.com/v1/car-details-view/YK03588/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27602add-974d-5390-880c-7d9b8820a317 with identifier: YK03588
2025-12-05 10:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27602add-974d-5390-880c-7d9b8820a317 with scrape type 2
2025-12-05 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27602add-974d-5390-880c-7d9b8820a317 with scrape type 2
2025-12-05 10:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27602add-974d-5390-880c-7d9b8820a317, identifier: YK03588
2025-12-05 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27602add-974d-5390-880c-7d9b8820a317 with identifier: YK03588
2025-12-05 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27602add-974d-5390-880c-7d9b8820a317 with identifier: YK03588
2025-12-05 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150175 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150175
2025-12-05 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 27602add-974d-5390-880c-7d9b8820a317 spider: auto1.it
2025-12-05 10:35:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 27602add-974d-5390-880c-7d9b8820a317 due to rule: high_mileage_for_country.json, error: 150175 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150175
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-05T16:27:59Z',
 'fuel_type': 'diesel',
 'id': '27602add-974d-5390-880c-7d9b8820a317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK03588',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 150175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM B-Tech',
 'transmission': 'automatic',
 'trim': 'B-Tech',
 'year': 2020}
2025-12-05 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK03588%27 HTTP/1.1" 200 None
2025-12-05 10:35:18 [auto1.it] INFO: Saving data for YK03588: {'auction_closing_time': 1764952079.0, 'created_time': 1764446576.293996, 'last_price_update_time': 1764930918.860985}
2025-12-05 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK03588') HTTP/1.1" 204 0
2025-12-05 10:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_82c8cd4db99940901359c568cadc58f9.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3f349d0>
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_82c8cd4db99940901359c568cadc58f9.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_82c8cd4db99940901359c568cadc58f9.jpg saved to cache
2025-12-05 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD94632> (referer: https://www.auto1.com/v1/car-details-view/UD94632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2025-12-05 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3fe02e-68d3-59b0-95d9-2774a7386941 with scrape type 2
2025-12-05 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd3fe02e-68d3-59b0-95d9-2774a7386941 with scrape type 2
2025-12-05 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd3fe02e-68d3-59b0-95d9-2774a7386941, identifier: UD94632
2025-12-05 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2025-12-05 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2025-12-05 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632 to the API
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD94632>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:56:12Z',
 'fuel_type': 'diesel',
 'id': 'dd3fe02e-68d3-59b0-95d9-2774a7386941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD94632',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 81528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2025-12-05 10:35:22 [auto1.it] INFO: Saving data for UD94632: {'auction_closing_time': 1764953772.0, 'created_time': 1764842563.148818, 'last_price_update_time': 1764930922.901154}
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD94632') HTTP/1.1" 204 0
2025-12-05 10:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3078a50>
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_11.jpg HTTP/1.1" 201 0
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg saved to cache
2025-12-05 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH55073> (referer: https://www.auto1.com/v1/car-details-view/WH55073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af94fda0-6da6-532f-b9f7-17f9f157364d with identifier: WH55073
2025-12-05 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af94fda0-6da6-532f-b9f7-17f9f157364d with scrape type 2
2025-12-05 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af94fda0-6da6-532f-b9f7-17f9f157364d with scrape type 2
2025-12-05 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af94fda0-6da6-532f-b9f7-17f9f157364d, identifier: WH55073
2025-12-05 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af94fda0-6da6-532f-b9f7-17f9f157364d with identifier: WH55073
2025-12-05 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af94fda0-6da6-532f-b9f7-17f9f157364d with identifier: WH55073
2025-12-05 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af94fda0-6da6-532f-b9f7-17f9f157364d with identifier: WH55073 to the API
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WH55073>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2025-12-05T16:23:26Z',
 'fuel_type': 'petrol',
 'id': 'af94fda0-6da6-532f-b9f7-17f9f157364d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH55073',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 115468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55073%27 HTTP/1.1" 200 None
2025-12-05 10:35:27 [auto1.it] INFO: Saving data for WH55073: {'auction_closing_time': 1764951806.0, 'created_time': 1764446573.757974, 'last_price_update_time': 1764930927.37931}
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH55073') HTTP/1.1" 204 0
2025-12-05 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL24739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY05920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_42f5d6312244b637b9af08a85c132b79.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR58377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da335ec10>
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_42f5d6312244b637b9af08a85c132b79.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_42f5d6312244b637b9af08a85c132b79.jpg saved to cache
2025-12-05 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da307ad90>
2025-12-05 10:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg saved to cache
2025-12-05 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH90153> (referer: https://www.auto1.com/v1/car-details-view/VH90153/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477c4f89-c95f-5270-b032-6c69cb8a38bf with identifier: VH90153
2025-12-05 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477c4f89-c95f-5270-b032-6c69cb8a38bf with scrape type 2
2025-12-05 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477c4f89-c95f-5270-b032-6c69cb8a38bf with scrape type 2
2025-12-05 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 477c4f89-c95f-5270-b032-6c69cb8a38bf, identifier: VH90153
2025-12-05 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 477c4f89-c95f-5270-b032-6c69cb8a38bf with identifier: VH90153
2025-12-05 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 477c4f89-c95f-5270-b032-6c69cb8a38bf with identifier: VH90153
2025-12-05 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 477c4f89-c95f-5270-b032-6c69cb8a38bf with identifier: VH90153 to the API
2025-12-05 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH90153>
{'auction_title': '',
 'c_o_2_emission_value': 235,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.8L',
 'engine_horse_power': 200,
 'expiration_date': '2025-12-05T16:38:24Z',
 'fuel_type': 'diesel',
 'id': '477c4f89-c95f-5270-b032-6c69cb8a38bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH90153',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 131534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2018}
2025-12-05 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH90153%27 HTTP/1.1" 200 None
2025-12-05 10:35:38 [auto1.it] INFO: Saving data for VH90153: {'auction_closing_time': 1764952704.0, 'created_time': 1764842582.979695, 'last_price_update_time': 1764930938.247779}
2025-12-05 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH90153') HTTP/1.1" 204 0
2025-12-05 10:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC72396> (referer: https://www.auto1.com/v1/car-details-view/ZC72396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84aebbe2-8cfe-5237-8888-babe9d419196 with identifier: ZC72396
2025-12-05 10:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aebbe2-8cfe-5237-8888-babe9d419196 with scrape type 2
2025-12-05 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84aebbe2-8cfe-5237-8888-babe9d419196 with scrape type 2
2025-12-05 10:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84aebbe2-8cfe-5237-8888-babe9d419196, identifier: ZC72396
2025-12-05 10:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84aebbe2-8cfe-5237-8888-babe9d419196 with identifier: ZC72396
2025-12-05 10:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84aebbe2-8cfe-5237-8888-babe9d419196 with identifier: ZC72396
2025-12-05 10:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 84aebbe2-8cfe-5237-8888-babe9d419196 with identifier: ZC72396 to the API
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC72396>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2025-12-05T16:29:04Z',
 'fuel_type': 'diesel',
 'id': '84aebbe2-8cfe-5237-8888-babe9d419196',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC72396',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 91382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC72396%27 HTTP/1.1" 200 None
2025-12-05 10:35:40 [auto1.it] INFO: Saving data for ZC72396: {'auction_closing_time': 1764952144.0, 'created_time': 1764842589.120476, 'last_price_update_time': 1764930940.420032}
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZC72396') HTTP/1.1" 204 0
2025-12-05 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR03874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_903c35649d31eceb2ec7bd035e095dd7.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3086e50>
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_14.jpg HTTP/1.1" 201 0
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_903c35649d31eceb2ec7bd035e095dd7.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_903c35649d31eceb2ec7bd035e095dd7.jpg saved to cache
2025-12-05 10:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 817.638(s), this was the 6th time calling it.
2025-12-05 10:35:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 33.05288821201735 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY09053> (referer: https://www.auto1.com/v1/car-details-view/DY09053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 with identifier: DY09053
2025-12-05 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 with scrape type 2
2025-12-05 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 with scrape type 2
2025-12-05 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78, identifier: DY09053
2025-12-05 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 with identifier: DY09053
2025-12-05 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 with identifier: DY09053
2025-12-05 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2025-12-05 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 spider: auto1.it
2025-12-05 10:35:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8bde5ef6-a00c-562a-a4e4-e92f81ab6b78 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-05T16:08:19Z',
 'fuel_type': 'diesel',
 'id': '8bde5ef6-a00c-562a-a4e4-e92f81ab6b78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY09053',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 19273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2024}
2025-12-05 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY09053%27 HTTP/1.1" 200 None
2025-12-05 10:35:48 [auto1.it] INFO: Saving data for DY09053: {'auction_closing_time': 1764950899.0, 'created_time': 1764446459.596967, 'last_price_update_time': 1764930948.723409}
2025-12-05 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY09053') HTTP/1.1" 204 0
2025-12-05 10:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eedd90>
2025-12-05 10:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_4.jpg HTTP/1.1" 201 0
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg saved to cache
2025-12-05 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ47835/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3d2ded0>
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_13.jpg HTTP/1.1" 201 0
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg saved to cache
2025-12-05 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG21070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db363df90>
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F12%252F5f12f81ad9241470e4cd75ad46cd8e10%252Fpa%252FZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg saved to cache
2025-12-05 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7dacc1a-b131-5d63-9a51-a3ae414778f5
2025-12-05 10:35:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7dacc1a-b131-5d63-9a51-a3ae414778f5, skipping ID generation
2025-12-05 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7dacc1a-b131-5d63-9a51-a3ae414778f5 with scrape type 1
2025-12-05 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7dacc1a-b131-5d63-9a51-a3ae414778f5 from tracking dictionaries
2025-12-05 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7dacc1a-b131-5d63-9a51-a3ae414778f5 sending to next pipeline
2025-12-05 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7dacc1a-b131-5d63-9a51-a3ae414778f5, identifier: ZZ38543
2025-12-05 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7dacc1a-b131-5d63-9a51-a3ae414778f5 with identifier: ZZ38543
2025-12-05 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7dacc1a-b131-5d63-9a51-a3ae414778f5 with identifier: ZZ38543
2025-12-05 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7dacc1a-b131-5d63-9a51-a3ae414778f5 with identifier: ZZ38543 to the API
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2025-12-06T16:29:05Z',
 'fuel_type': 'petrol',
 'id': 'b7dacc1a-b131-5d63-9a51-a3ae414778f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ38543',
 'listing': 'auction',
 'location': 'IT, Tradein',
 'make': 'Mahindra',
 'model': 'KUV 100',
 'odometer': 34438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_c1fb0327316f2275ce1bede1dc9c0855.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_2664a918befefcb2a112ab081ab04d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1b5c93bab2644ba9425e600860d83ef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_d1663a5076d54c8569217c2f4e6ed165.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2348039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_aa04a2890259385cfd29e0a4b1d7f49b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_e3271fda04a6e048992c4d9e9f96f118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_42f5d6312244b637b9af08a85c132b79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_05ae44d26fa85e70577d197272d3d231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_7850a7b583c2c9c1a0cc2f405597b8a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_ce3a306373df0ce0551ebee2fbc41b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_1557dd6a6e3f2370664660c57168a62d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_5e1d8ef248b3f2e0d4a22f9e7e204347.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_07222e23329d1c56262f3c850f3da756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_010aa5e297de45ab9010c25f20f6295b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7dacc1a-b131-5d63-9a51-a3ae414778f5/b7dacc1a-b131-5d63-9a51-a3ae414778f5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/12/5f12f81ad9241470e4cd75ad46cd8e10/pa/ZZ38543_82c8cd4db99940901359c568cadc58f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mahindra KUV 100 1.2 K8',
 'transmission': 'manual',
 'trim': 'K8',
 'year': 2022}
2025-12-05 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ38543%27 HTTP/1.1" 200 None
2025-12-05 10:35:52 [auto1.it] INFO: Saving data for ZZ38543: {'created_time': 1764930952.002688, 'last_price_update_time': 1764930952.002697, 'auction_closing_time': 1765038545.0}
2025-12-05 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ38543') HTTP/1.1" 204 0
2025-12-05 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY05920> (referer: https://www.auto1.com/v1/car-details-view/GY05920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53db4c6f-1956-5839-b006-3c8084121da2 with identifier: GY05920
2025-12-05 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53db4c6f-1956-5839-b006-3c8084121da2 with scrape type 2
2025-12-05 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53db4c6f-1956-5839-b006-3c8084121da2 with scrape type 2
2025-12-05 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53db4c6f-1956-5839-b006-3c8084121da2, identifier: GY05920
2025-12-05 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53db4c6f-1956-5839-b006-3c8084121da2 with identifier: GY05920
2025-12-05 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53db4c6f-1956-5839-b006-3c8084121da2 with identifier: GY05920
2025-12-05 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53db4c6f-1956-5839-b006-3c8084121da2 with identifier: GY05920 to the API
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY05920>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:19:25Z',
 'fuel_type': 'diesel',
 'id': '53db4c6f-1956-5839-b006-3c8084121da2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY05920',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 11598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2021}
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY05920%27 HTTP/1.1" 200 None
2025-12-05 10:35:53 [auto1.it] INFO: Saving data for GY05920: {'auction_closing_time': 1764951565.0, 'created_time': 1764842575.935229, 'last_price_update_time': 1764930953.546316}
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY05920') HTTP/1.1" 204 0
2025-12-05 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK07610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1f96ea5618384b7dca214230383514ab.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9db2155f90>
2025-12-05 10:35:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_12.jpg HTTP/1.1" 201 0
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_1f96ea5618384b7dca214230383514ab.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1f96ea5618384b7dca214230383514ab.jpg saved to cache
2025-12-05 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG15612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_c134a19f4868ff6ced7b52d11df06254.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da33effd0>
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_9.jpg HTTP/1.1" 201 0
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_c134a19f4868ff6ced7b52d11df06254.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_c134a19f4868ff6ced7b52d11df06254.jpg saved to cache
2025-12-05 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_21b167afae0241c5e70293db6914a78e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eed110>
2025-12-05 10:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_21b167afae0241c5e70293db6914a78e.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_21b167afae0241c5e70293db6914a78e.jpg saved to cache
2025-12-05 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ55046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_4126c6cd5e628058850f7f84a49bc701.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da332c650>
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_4126c6cd5e628058850f7f84a49bc701.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_4126c6cd5e628058850f7f84a49bc701.jpg saved to cache
2025-12-05 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR58377> (referer: https://www.auto1.com/v1/car-details-view/LR58377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e17e6f-0a87-57f8-973d-f108a5031a63 with identifier: LR58377
2025-12-05 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e17e6f-0a87-57f8-973d-f108a5031a63 with scrape type 2
2025-12-05 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e17e6f-0a87-57f8-973d-f108a5031a63 with scrape type 2
2025-12-05 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0e17e6f-0a87-57f8-973d-f108a5031a63, identifier: LR58377
2025-12-05 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0e17e6f-0a87-57f8-973d-f108a5031a63 with identifier: LR58377
2025-12-05 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0e17e6f-0a87-57f8-973d-f108a5031a63 with identifier: LR58377
2025-12-05 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0e17e6f-0a87-57f8-973d-f108a5031a63 with identifier: LR58377 to the API
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR58377>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 158,
 'expiration_date': '2025-12-05T16:14:46Z',
 'fuel_type': 'hybrid',
 'id': 'b0e17e6f-0a87-57f8-973d-f108a5031a63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR58377',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 38430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR58377%27 HTTP/1.1" 200 None
2025-12-05 10:35:58 [auto1.it] INFO: Saving data for LR58377: {'auction_closing_time': 1764951286.0, 'created_time': 1762287100.01061, 'last_price_update_time': 1764930958.283575}
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR58377') HTTP/1.1" 204 0
2025-12-05 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d88d2de112a6e7b869a6a08a64119e06.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eee210>
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_6.jpg HTTP/1.1" 201 0
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_d88d2de112a6e7b869a6a08a64119e06.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d88d2de112a6e7b869a6a08a64119e06.jpg saved to cache
2025-12-05 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3eddf90>
2025-12-05 10:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_3.jpg HTTP/1.1" 201 0
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0c%252Ff50c97b08179c133f56c19d7113dfdf3%252Fpa%252FNH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg') HTTP/1.1" 204 0
2025-12-05 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg saved to cache
2025-12-05 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40
2025-12-05 10:35:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40, skipping ID generation
2025-12-05 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with scrape type 1
2025-12-05 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 from tracking dictionaries
2025-12-05 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 sending to next pipeline
2025-12-05 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40, identifier: NH86693
2025-12-05 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with identifier: NH86693
2025-12-05 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with identifier: NH86693
2025-12-05 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 985f2df9-f3c7-5fb5-b8f0-30b252ecda40 with identifier: NH86693 to the API
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2025-12-06T16:49:07Z',
 'fuel_type': 'diesel',
 'id': '985f2df9-f3c7-5fb5-b8f0-30b252ecda40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH86693',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 93178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_a215f5b8ff8f5e1dec7ffcafc0e209ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_2b5a886eac947090c1db1a0768a5f49e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_12926ed01f8ead5e32ef85e58913ab1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d9aa8959b46f6596cab198773b5bb1a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_26a5301b0d56c10c412235afa92e66ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1bf61eb18a9655a5e4449d8940112a8f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_d88d2de112a6e7b869a6a08a64119e06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_4126c6cd5e628058850f7f84a49bc701.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_21b167afae0241c5e70293db6914a78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_c134a19f4868ff6ced7b52d11df06254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_7b1679a6dd2452835f7c95d381719ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_9b19fa10b41439903f13efc115c56575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_1f96ea5618384b7dca214230383514ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_15ae0679e25355367dd3cf529d9e2ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_985f2df9-f3c7-5fb5-b8f0-30b252ecda40/985f2df9-f3c7-5fb5-b8f0-30b252ecda40_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0c/f50c97b08179c133f56c19d7113dfdf3/pa/NH86693_903c35649d31eceb2ec7bd035e095dd7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH86693%27 HTTP/1.1" 200 None
2025-12-05 10:35:59 [auto1.it] INFO: Saving data for NH86693: {'created_time': 1764930959.860118, 'last_price_update_time': 1764930959.86013, 'auction_closing_time': 1765039747.0}
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH86693') HTTP/1.1" 204 0
2025-12-05 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_07ed1e070c74679564de191ca65e4c7e.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR03874> (referer: https://www.auto1.com/v1/car-details-view/XR03874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3453890>
2025-12-05 10:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_8.jpg HTTP/1.1" 201 0
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_07ed1e070c74679564de191ca65e4c7e.jpg') HTTP/1.1" 204 0
2025-12-05 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_07ed1e070c74679564de191ca65e4c7e.jpg saved to cache
2025-12-05 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with identifier: XR03874
2025-12-05 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with scrape type 2
2025-12-05 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with scrape type 2
2025-12-05 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a137b8b1-e2cd-5fcc-8e15-00ad622ffa91, identifier: XR03874
2025-12-05 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with identifier: XR03874
2025-12-05 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with identifier: XR03874
2025-12-05 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a137b8b1-e2cd-5fcc-8e15-00ad622ffa91 with identifier: XR03874 to the API
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR03874>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2025-12-05T16:57:33Z',
 'fuel_type': 'petrol',
 'id': 'a137b8b1-e2cd-5fcc-8e15-00ad622ffa91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR03874',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 17057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2023}
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR03874%27 HTTP/1.1" 200 None
2025-12-05 10:36:00 [auto1.it] INFO: Saving data for XR03874: {'auction_closing_time': 1764953853.0, 'created_time': 1762941682.991239, 'last_price_update_time': 1764930960.733097}
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR03874') HTTP/1.1" 204 0
2025-12-05 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg> (referer: https://www.auto1.com/)
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPad mini (A17 Pro)\x00'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 188 - value: b'18.7.2\x00'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 196 - value: b'2025:12:03 09:30:21\x00'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 216 - value: b'iPad mini (A17 Pro)\x00'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2025-12-05 10:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xec'
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9da3344d10>
2025-12-05 10:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 10:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_7.jpg HTTP/1.1" 201 0
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252Fa7%252F84a7cc393bf5ee1f53d9f878bf0e5c98%252Fpa%252FBX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg') HTTP/1.1" 204 0
2025-12-05 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg saved to cache
2025-12-05 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6e39615-22c7-50f7-b3ac-cf83f5319e12
2025-12-05 10:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6e39615-22c7-50f7-b3ac-cf83f5319e12, skipping ID generation
2025-12-05 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e39615-22c7-50f7-b3ac-cf83f5319e12 with scrape type 1
2025-12-05 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e6e39615-22c7-50f7-b3ac-cf83f5319e12 from tracking dictionaries
2025-12-05 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6e39615-22c7-50f7-b3ac-cf83f5319e12 sending to next pipeline
2025-12-05 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6e39615-22c7-50f7-b3ac-cf83f5319e12, identifier: BX65546
2025-12-05 10:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6e39615-22c7-50f7-b3ac-cf83f5319e12 with identifier: BX65546
2025-12-05 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6e39615-22c7-50f7-b3ac-cf83f5319e12 with identifier: BX65546
2025-12-05 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2025-12-05 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e6e39615-22c7-50f7-b3ac-cf83f5319e12 spider: auto1.it
2025-12-05 10:36:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e6e39615-22c7-50f7-b3ac-cf83f5319e12 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2025-12-06T16:22:46Z',
 'fuel_type': 'diesel',
 'id': 'e6e39615-22c7-50f7-b3ac-cf83f5319e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX65546',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 134269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4982962,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_2a8db6d406824ae19fb64b5f644aa18f.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4982962,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_a3c2c8e2c45339284dc391fdbf8392cc.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4036304,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_244d8f1d924d96e867877dafe4f994d1.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_238e8157a2e4f0c436a56c61f3543bb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_cb7e7a22b0f8131ef983a4e91d0f6e62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f642f63657daefd566597d0816c95da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_0b3af939a7853368008d301fff6b834c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3149821,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_f15e7b1e416f9635ca14273038e7e2cc.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_07ed1e070c74679564de191ca65e4c7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_6f5975c7b0675c396d9a61144f92ccab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_32dbfb8e53363f6e5d13ba2e6537733f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_42bff4bff8adf5531b1614343935d56a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_649962053988b5190b7fda321b9383ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_13.png',
             'Extension': 'png',
             'FileSizeInBytes': 834987,
             'Height': 594,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_1edae1e2615d8d482ad043e62e5a0807.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6e39615-22c7-50f7-b3ac-cf83f5319e12/e6e39615-22c7-50f7-b3ac-cf83f5319e12_image_14.png',
             'Extension': 'png',
             'FileSizeInBytes': 17976130,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img84/a7/84a7cc393bf5ee1f53d9f878bf0e5c98/pa/BX65546_300d69a2ed08ea1d2a0cc72327c1ef83.png',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 413 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX65546%27 HTTP/1.1" 200 None
2025-12-05 10:36:01 [auto1.it] INFO: Saving data for BX65546: {'created_time': 1764930961.504412, 'last_price_update_time': 1764930961.504422, 'auction_closing_time': 1765038166.0}
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX65546') HTTP/1.1" 204 0
2025-12-05 10:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS56178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL24739> (referer: https://www.auto1.com/v1/car-details-view/YL24739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e0ca72-d85e-545d-b556-18ebabf0f0ec with identifier: YL24739
2025-12-05 10:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e0ca72-d85e-545d-b556-18ebabf0f0ec with scrape type 2
2025-12-05 10:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e0ca72-d85e-545d-b556-18ebabf0f0ec with scrape type 2
2025-12-05 10:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40e0ca72-d85e-545d-b556-18ebabf0f0ec, identifier: YL24739
2025-12-05 10:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40e0ca72-d85e-545d-b556-18ebabf0f0ec with identifier: YL24739
2025-12-05 10:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40e0ca72-d85e-545d-b556-18ebabf0f0ec with identifier: YL24739
2025-12-05 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40e0ca72-d85e-545d-b556-18ebabf0f0ec with identifier: YL24739 to the API
2025-12-05 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL24739>
{'auction_title': '',
 'c_o_2_emission_value': 254,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 390,
 'expiration_date': '2025-12-05T16:46:40Z',
 'fuel_type': 'petrol',
 'id': '40e0ca72-d85e-545d-b556-18ebabf0f0ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL24739',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 69989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2025-12-05 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL24739%27 HTTP/1.1" 200 None
2025-12-05 10:36:04 [auto1.it] INFO: Saving data for YL24739: {'auction_closing_time': 1764953200.0, 'created_time': 1764842520.076619, 'last_price_update_time': 1764930964.998757}
2025-12-05 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL24739') HTTP/1.1" 204 0
2025-12-05 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG21070> (referer: https://www.auto1.com/v1/car-details-view/TG21070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b98311-2dd6-572c-8d44-a06ec76c676c with identifier: TG21070
2025-12-05 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b98311-2dd6-572c-8d44-a06ec76c676c with scrape type 2
2025-12-05 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8b98311-2dd6-572c-8d44-a06ec76c676c with scrape type 2
2025-12-05 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8b98311-2dd6-572c-8d44-a06ec76c676c, identifier: TG21070
2025-12-05 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8b98311-2dd6-572c-8d44-a06ec76c676c with identifier: TG21070
2025-12-05 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8b98311-2dd6-572c-8d44-a06ec76c676c with identifier: TG21070
2025-12-05 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 caravelle' containing 'caravelle'
2025-12-05 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e8b98311-2dd6-572c-8d44-a06ec76c676c spider: auto1.it
2025-12-05 10:36:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: e8b98311-2dd6-572c-8d44-a06ec76c676c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 caravelle' containing 'caravelle'
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:07:48Z',
 'fuel_type': 'diesel',
 'id': 'e8b98311-2dd6-572c-8d44-a06ec76c676c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG21070',
 'listing': 'auction',
 'location': 'IT, Parma',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 53014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-10',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2025-12-05 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG21070%27 HTTP/1.1" 200 None
2025-12-05 10:36:07 [auto1.it] INFO: Saving data for TG21070: {'auction_closing_time': 1764950868.0, 'created_time': 1764842573.56536, 'last_price_update_time': 1764930967.009223}
2025-12-05 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TG21070') HTTP/1.1" 204 0
2025-12-05 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN76439/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ47835> (referer: https://www.auto1.com/v1/car-details-view/TJ47835/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with identifier: TJ47835
2025-12-05 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with scrape type 2
2025-12-05 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with scrape type 2
2025-12-05 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a7c88b9-1e0c-51f4-b45e-32a651cb923e, identifier: TJ47835
2025-12-05 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with identifier: TJ47835
2025-12-05 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with identifier: TJ47835
2025-12-05 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a7c88b9-1e0c-51f4-b45e-32a651cb923e with identifier: TJ47835 to the API
2025-12-05 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TJ47835>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:49:57Z',
 'fuel_type': 'petrol',
 'id': '5a7c88b9-1e0c-51f4-b45e-32a651cb923e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ47835',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 46732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI S Line Edition',
 'transmission': 'automatic',
 'trim': 'S Line Edition',
 'year': 2020}
2025-12-05 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ47835%27 HTTP/1.1" 200 None
2025-12-05 10:36:10 [auto1.it] INFO: Saving data for TJ47835: {'auction_closing_time': 1764953397.0, 'created_time': 1762891580.661997, 'last_price_update_time': 1764930970.063582}
2025-12-05 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ47835') HTTP/1.1" 204 0
2025-12-05 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG15612> (referer: https://www.auto1.com/v1/car-details-view/LG15612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14019892-58d9-5856-9b6b-5ed3845122f9 with identifier: LG15612
2025-12-05 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14019892-58d9-5856-9b6b-5ed3845122f9 with scrape type 2
2025-12-05 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14019892-58d9-5856-9b6b-5ed3845122f9 with scrape type 2
2025-12-05 10:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14019892-58d9-5856-9b6b-5ed3845122f9, identifier: LG15612
2025-12-05 10:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14019892-58d9-5856-9b6b-5ed3845122f9 with identifier: LG15612
2025-12-05 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14019892-58d9-5856-9b6b-5ed3845122f9 with identifier: LG15612
2025-12-05 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144161 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144161
2025-12-05 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 14019892-58d9-5856-9b6b-5ed3845122f9 spider: auto1.it
2025-12-05 10:36:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 14019892-58d9-5856-9b6b-5ed3845122f9 due to rule: high_mileage_for_make.json, error: 144161 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144161
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:15:36Z',
 'fuel_type': 'diesel',
 'id': '14019892-58d9-5856-9b6b-5ed3845122f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG15612',
 'listing': 'auction',
 'location': 'IT, Rozzano',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 144161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2017}
2025-12-05 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG15612%27 HTTP/1.1" 200 None
2025-12-05 10:36:11 [auto1.it] INFO: Saving data for LG15612: {'auction_closing_time': 1764951336.0, 'created_time': 1764842540.233269, 'last_price_update_time': 1764930971.927259}
2025-12-05 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG15612') HTTP/1.1" 204 0
2025-12-05 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 7th time calling it.
2025-12-05 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH40683> (referer: https://www.auto1.com/v1/car-details-view/TH40683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b with identifier: TH40683
2025-12-05 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b with scrape type 2
2025-12-05 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b with scrape type 2
2025-12-05 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b, identifier: TH40683
2025-12-05 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b with identifier: TH40683
2025-12-05 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b with identifier: TH40683
2025-12-05 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188118 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188118
2025-12-05 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b spider: auto1.it
2025-12-05 10:36:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 014dfadd-f41f-51f0-ab0c-7c7d8241bc8b due to rule: high_mileage_for_country.json, error: 188118 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188118
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2025-12-05T16:30:33Z',
 'fuel_type': 'diesel',
 'id': '014dfadd-f41f-51f0-ab0c-7c7d8241bc8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH40683',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 188118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM S-Design',
 'transmission': 'automatic',
 'trim': 'S-Design',
 'year': 2018}
2025-12-05 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH40683%27 HTTP/1.1" 200 None
2025-12-05 10:36:15 [auto1.it] INFO: Saving data for TH40683: {'auction_closing_time': 1764952233.0, 'created_time': 1764410470.013058, 'last_price_update_time': 1764930975.837351}
2025-12-05 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH40683') HTTP/1.1" 204 0
2025-12-05 10:36:17 [scrapy.extensions.logstats] INFO: Crawled 445 pages (at 25 pages/min), scraped 158 items (at 11 items/min)
2025-12-05 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ55046> (referer: https://www.auto1.com/v1/car-details-view/LZ55046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with identifier: LZ55046
2025-12-05 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with scrape type 2
2025-12-05 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with scrape type 2
2025-12-05 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27399bdc-9e4d-59b8-88a0-4413dac6f4c4, identifier: LZ55046
2025-12-05 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with identifier: LZ55046
2025-12-05 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with identifier: LZ55046
2025-12-05 10:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27399bdc-9e4d-59b8-88a0-4413dac6f4c4 with identifier: LZ55046 to the API
2025-12-05 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ55046>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2025-12-05T16:34:07Z',
 'fuel_type': 'gas',
 'id': '27399bdc-9e4d-59b8-88a0-4413dac6f4c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ55046',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 51811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression',
 'transmission': 'manual',
 'trim': 'Stepway Expression',
 'year': 2023}
2025-12-05 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ55046%27 HTTP/1.1" 200 None
2025-12-05 10:36:20 [auto1.it] INFO: Saving data for LZ55046: {'auction_closing_time': 1764952447.0, 'created_time': 1764842571.321499, 'last_price_update_time': 1764930980.007088}
2025-12-05 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LZ55046') HTTP/1.1" 204 0
2025-12-05 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS56178> (referer: https://www.auto1.com/v1/car-details-view/RS56178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d94676d-717b-5462-a426-dbf3f1e9e193 with identifier: RS56178
2025-12-05 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d94676d-717b-5462-a426-dbf3f1e9e193 with scrape type 2
2025-12-05 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d94676d-717b-5462-a426-dbf3f1e9e193 with scrape type 2
2025-12-05 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d94676d-717b-5462-a426-dbf3f1e9e193, identifier: RS56178
2025-12-05 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d94676d-717b-5462-a426-dbf3f1e9e193 with identifier: RS56178
2025-12-05 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d94676d-717b-5462-a426-dbf3f1e9e193 with identifier: RS56178
2025-12-05 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d94676d-717b-5462-a426-dbf3f1e9e193 with identifier: RS56178 to the API
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RS56178>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2025-12-05T16:21:53Z',
 'fuel_type': 'petrol',
 'id': '2d94676d-717b-5462-a426-dbf3f1e9e193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS56178',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 71720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56178%27 HTTP/1.1" 200 None
2025-12-05 10:36:24 [auto1.it] INFO: Saving data for RS56178: {'auction_closing_time': 1764951713.0, 'created_time': 1764842585.21496, 'last_price_update_time': 1764930984.21228}
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS56178') HTTP/1.1" 204 0
2025-12-05 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN76439> (referer: https://www.auto1.com/v1/car-details-view/SN76439/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10d6d940-3f15-53ce-a284-a073e48f7fbe with identifier: SN76439
2025-12-05 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10d6d940-3f15-53ce-a284-a073e48f7fbe with scrape type 2
2025-12-05 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10d6d940-3f15-53ce-a284-a073e48f7fbe with scrape type 2
2025-12-05 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10d6d940-3f15-53ce-a284-a073e48f7fbe, identifier: SN76439
2025-12-05 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10d6d940-3f15-53ce-a284-a073e48f7fbe with identifier: SN76439
2025-12-05 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10d6d940-3f15-53ce-a284-a073e48f7fbe with identifier: SN76439
2025-12-05 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10d6d940-3f15-53ce-a284-a073e48f7fbe with identifier: SN76439 to the API
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN76439>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 122,
 'expiration_date': '2025-12-05T16:03:35Z',
 'fuel_type': 'diesel',
 'id': '10d6d940-3f15-53ce-a284-a073e48f7fbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN76439',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 106188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Business Elegance Start/Stop',
 'transmission': 'automatic',
 'trim': 'Business Elegance Start/Stop',
 'year': 2021}
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN76439%27 HTTP/1.1" 200 None
2025-12-05 10:36:25 [auto1.it] INFO: Saving data for SN76439: {'auction_closing_time': 1764950615.0, 'created_time': 1764842567.392607, 'last_price_update_time': 1764930985.788047}
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN76439') HTTP/1.1" 204 0
2025-12-05 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH47272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC05973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE37402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE37402> (referer: https://www.auto1.com/v1/car-details-view/DE37402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ab4ea4-ad43-51d4-8621-e779722e009a with identifier: DE37402
2025-12-05 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ab4ea4-ad43-51d4-8621-e779722e009a with scrape type 2
2025-12-05 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ab4ea4-ad43-51d4-8621-e779722e009a with scrape type 2
2025-12-05 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8ab4ea4-ad43-51d4-8621-e779722e009a, identifier: DE37402
2025-12-05 10:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8ab4ea4-ad43-51d4-8621-e779722e009a with identifier: DE37402
2025-12-05 10:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8ab4ea4-ad43-51d4-8621-e779722e009a with identifier: DE37402
2025-12-05 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
2025-12-05 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b8ab4ea4-ad43-51d4-8621-e779722e009a spider: auto1.it
2025-12-05 10:36:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: b8ab4ea4-ad43-51d4-8621-e779722e009a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 110,
 'expiration_date': '2025-12-05T16:47:21Z',
 'fuel_type': 'diesel',
 'id': 'b8ab4ea4-ad43-51d4-8621-e779722e009a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE37402',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 94935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2020}
2025-12-05 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE37402%27 HTTP/1.1" 200 None
2025-12-05 10:36:42 [auto1.it] INFO: Saving data for DE37402: {'auction_closing_time': 1764953241.0, 'created_time': 1763496514.859816, 'last_price_update_time': 1764931002.215913}
2025-12-05 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE37402') HTTP/1.1" 204 0
2025-12-05 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK07610> (referer: https://www.auto1.com/v1/car-details-view/VK07610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2025-12-05 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09a8b28-d492-5241-be90-b61ead680804 with scrape type 2
2025-12-05 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09a8b28-d492-5241-be90-b61ead680804 with scrape type 2
2025-12-05 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a09a8b28-d492-5241-be90-b61ead680804, identifier: VK07610
2025-12-05 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2025-12-05 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a09a8b28-d492-5241-be90-b61ead680804 with identifier: VK07610
2025-12-05 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
2025-12-05 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a09a8b28-d492-5241-be90-b61ead680804 spider: auto1.it
2025-12-05 10:36:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: a09a8b28-d492-5241-be90-b61ead680804 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit custom' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2025-12-05T16:31:50Z',
 'fuel_type': 'diesel',
 'id': 'a09a8b28-d492-5241-be90-b61ead680804',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK07610',
 'listing': 'auction',
 'location': 'IT, Cinisello Balsamo',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 78575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
 'transmission': 'manual',
 'trim': '300 L2 Trend',
 'year': 2019}
2025-12-05 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2025-12-05 10:36:44 [auto1.it] INFO: Saving data for VK07610: {'auction_closing_time': 1764952310.0, 'created_time': 1764842467.303681, 'last_price_update_time': 1764931004.435894}
2025-12-05 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK07610') HTTP/1.1" 204 0
2025-12-05 10:37:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.107(s), this was the 1st time calling it.
2025-12-05 10:37:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.812425152734711 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:37:17 [scrapy.extensions.logstats] INFO: Crawled 453 pages (at 8 pages/min), scraped 161 items (at 3 items/min)
2025-12-05 10:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:37:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.218(s), this was the 1st time calling it.
2025-12-05 10:37:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.940757289407783 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM46958> (referer: https://www.auto1.com/v1/car-details-view/JM46958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with identifier: JM46958
2025-12-05 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with scrape type 2
2025-12-05 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with scrape type 2
2025-12-05 10:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c90c082a-fc58-56ea-b9e4-3d1b59984fa0, identifier: JM46958
2025-12-05 10:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with identifier: JM46958
2025-12-05 10:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with identifier: JM46958
2025-12-05 10:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c90c082a-fc58-56ea-b9e4-3d1b59984fa0 with identifier: JM46958 to the API
2025-12-05 10:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM46958>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 130,
 'expiration_date': '2025-12-05T16:44:51Z',
 'fuel_type': 'petrol',
 'id': 'c90c082a-fc58-56ea-b9e4-3d1b59984fa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM46958',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 89844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2019}
2025-12-05 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM46958%27 HTTP/1.1" 200 None
2025-12-05 10:37:51 [auto1.it] INFO: Saving data for JM46958: {'auction_closing_time': 1764953091.0, 'created_time': 1762545947.213912, 'last_price_update_time': 1764931071.385761}
2025-12-05 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JM46958') HTTP/1.1" 204 0
2025-12-05 10:38:17 [scrapy.extensions.logstats] INFO: Crawled 454 pages (at 1 pages/min), scraped 162 items (at 1 items/min)
2025-12-05 10:38:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 981.482(s), this was the 7th time calling it.
2025-12-05 10:38:25 [scrapy_zyte_api.handler] DEBUG: Got an error when processing Zyte API request (https://www.auto1.com/en/app/merchant/car/BZ67729): Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)]
2025-12-05 10:38:25 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://www.auto1.com/en/app/merchant/car/BZ67729> (failed 1 times): Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)]
2025-12-05 10:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:38:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.441(s), this was the 1st time calling it.
2025-12-05 10:38:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.672071971339266 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:38:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.034(s), this was the 1st time calling it.
2025-12-05 10:38:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.004017571690216 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2025-12-05 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ67729> (referer: https://www.auto1.com/v1/car-details-view/BZ67729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b12804-6151-566c-ba8f-15f887d7844b with identifier: BZ67729
2025-12-05 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b12804-6151-566c-ba8f-15f887d7844b with scrape type 2
2025-12-05 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2b12804-6151-566c-ba8f-15f887d7844b with scrape type 2
2025-12-05 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2b12804-6151-566c-ba8f-15f887d7844b, identifier: BZ67729
2025-12-05 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2b12804-6151-566c-ba8f-15f887d7844b with identifier: BZ67729
2025-12-05 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2b12804-6151-566c-ba8f-15f887d7844b with identifier: BZ67729
2025-12-05 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156496 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156496
2025-12-05 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c2b12804-6151-566c-ba8f-15f887d7844b spider: auto1.it
2025-12-05 10:38:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c2b12804-6151-566c-ba8f-15f887d7844b due to rule: high_mileage_for_country.json, error: 156496 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156496
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2025-12-05T16:20:28Z',
 'fuel_type': 'diesel',
 'id': 'c2b12804-6151-566c-ba8f-15f887d7844b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ67729',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 156496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2025-12-05 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ67729%27 HTTP/1.1" 200 None
2025-12-05 10:38:45 [auto1.it] INFO: Saving data for BZ67729: {'auction_closing_time': 1764951628.0, 'created_time': 1764101312.398225, 'last_price_update_time': 1764931125.703993}
2025-12-05 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ67729') HTTP/1.1" 204 0
2025-12-05 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC05973> (referer: https://www.auto1.com/v1/car-details-view/SC05973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04486aa1-88b5-593b-bb2f-5beabb505805 with identifier: SC05973
2025-12-05 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04486aa1-88b5-593b-bb2f-5beabb505805 with scrape type 2
2025-12-05 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04486aa1-88b5-593b-bb2f-5beabb505805 with scrape type 2
2025-12-05 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04486aa1-88b5-593b-bb2f-5beabb505805, identifier: SC05973
2025-12-05 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04486aa1-88b5-593b-bb2f-5beabb505805 with identifier: SC05973
2025-12-05 10:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04486aa1-88b5-593b-bb2f-5beabb505805 with identifier: SC05973
2025-12-05 10:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04486aa1-88b5-593b-bb2f-5beabb505805 with identifier: SC05973 to the API
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC05973>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2025-12-05T16:12:47Z',
 'fuel_type': 'diesel',
 'id': '04486aa1-88b5-593b-bb2f-5beabb505805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC05973',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 62031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05973%27 HTTP/1.1" 200 None
2025-12-05 10:38:47 [auto1.it] INFO: Saving data for SC05973: {'auction_closing_time': 1764951167.0, 'created_time': 1764842570.245185, 'last_price_update_time': 1764931127.700638}
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC05973') HTTP/1.1" 204 0
2025-12-05 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH47272> (referer: https://www.auto1.com/v1/car-details-view/CH47272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f with identifier: CH47272
2025-12-05 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ca79b9-1d59-5156-b379-cc1d83fb1b8f with scrape type 2
2025-12-05 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ca79b9-1d59-5156-b379-cc1d83fb1b8f with scrape type 2
2025-12-05 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f, identifier: CH47272
2025-12-05 10:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f with identifier: CH47272
2025-12-05 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f with identifier: CH47272
2025-12-05 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147671 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147671
2025-12-05 10:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f spider: auto1.it
2025-12-05 10:39:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 36ca79b9-1d59-5156-b379-cc1d83fb1b8f due to rule: high_mileage_for_make.json, error: 147671 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147671
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2025-12-05T16:29:32Z',
 'fuel_type': 'petrol',
 'id': '36ca79b9-1d59-5156-b379-cc1d83fb1b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH47272',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Fiat',
 'model': '500',
 'odometer': 147671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2025-12-05 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH47272%27 HTTP/1.1" 200 None
2025-12-05 10:39:00 [auto1.it] INFO: Saving data for CH47272: {'auction_closing_time': 1764952172.0, 'created_time': 1764360366.159925, 'last_price_update_time': 1764931140.819808}
2025-12-05 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH47272') HTTP/1.1" 204 0
2025-12-05 10:39:17 [scrapy.extensions.logstats] INFO: Crawled 457 pages (at 3 pages/min), scraped 163 items (at 1 items/min)
2025-12-05 10:39:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.322(s), this was the 2nd time calling it.
2025-12-05 10:39:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.41155432455451 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2025-12-05 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2025-12-05 10:40:17 [scrapy.extensions.logstats] INFO: Crawled 457 pages (at 0 pages/min), scraped 163 items (at 0 items/min)
2025-12-05 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW51331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW51331> (referer: https://www.auto1.com/v1/car-details-view/CW51331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2025-12-05 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with identifier: CW51331
2025-12-05 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with scrape type 2
2025-12-05 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with scrape type 2
2025-12-05 10:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b, identifier: CW51331
2025-12-05 10:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with identifier: CW51331
2025-12-05 10:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with identifier: CW51331
2025-12-05 10:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b with identifier: CW51331 to the API
2025-12-05 10:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-05 10:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW51331>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2025-12-05T16:57:13Z',
 'fuel_type': 'petrol',
 'id': '9dcafcdc-e89f-5597-97ee-e7f0b54f7e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW51331',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 64353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW51331%27 HTTP/1.1" 200 None
2025-12-05 10:40:24 [auto1.it] INFO: Saving data for CW51331: {'auction_closing_time': 1764953833.0, 'created_time': 1762286809.740958, 'last_price_update_time': 1764931224.158779}
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW51331') HTTP/1.1" 204 0
2025-12-05 10:40:24 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 10:40:24 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201764499224 HTTP/1.1" 200 None
2025-12-05 10:40:24 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (164 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_75_2025-12-05T10_00_05.jl
2025-12-05 10:40:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 2,
 'downloader/exception_type_count/aiohttp.client_exceptions.ClientConnectorError': 2,
 'downloader/request_bytes': 1403979,
 'downloader/request_count': 731,
 'downloader/request_method_count/GET': 712,
 'downloader/request_method_count/POST': 19,
 'downloader/response_bytes': 209349488,
 'downloader/response_count': 729,
 'downloader/response_status_count/200': 729,
 'dupefilter/filtered': 39,
 'elapsed_time_seconds': 2346.411908,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 10, 40, 24, 350325, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 55,
 'item_dropped_reasons_count/DropItem': 55,
 'item_scraped_count': 164,
 'log_count/DEBUG': 6997,
 'log_count/ERROR': 3,
 'log_count/INFO': 5908,
 'memusage/max': 195977216,
 'memusage/startup': 128057344,
 'photo_download_count': 270,
 'request_depth_max': 21,
 'response_received_count': 459,
 'retry/count': 2,
 'retry/reason_count/aiohttp.client_exceptions.ClientConnectorError': 2,
 'scheduler/dequeued': 731,
 'scheduler/dequeued/memory': 731,
 'scheduler/enqueued': 731,
 'scheduler/enqueued/memory': 731,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 558,
 'scrapy-zyte-api/error_ratio': 0.1774193548387097,
 'scrapy-zyte-api/errors': 99,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 99,
 'scrapy-zyte-api/fatal_errors': 2,
 'scrapy-zyte-api/mean_connection_seconds': 8.07981477344073,
 'scrapy-zyte-api/mean_response_seconds': 8.10074949918455,
 'scrapy-zyte-api/processed': 461,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 461,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 460,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 461,
 'scrapy-zyte-api/request_args/httpRequestBody': 19,
 'scrapy-zyte-api/request_args/httpRequestMethod': 19,
 'scrapy-zyte-api/request_args/httpResponseBody': 461,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 461,
 'scrapy-zyte-api/request_args/sessionContext': 461,
 'scrapy-zyte-api/request_args/url': 461,
 'scrapy-zyte-api/status_codes/0': 99,
 'scrapy-zyte-api/status_codes/200': 459,
 'scrapy-zyte-api/success': 459,
 'scrapy-zyte-api/success_ratio': 0.9956616052060737,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 5, 10, 1, 17, 938417, tzinfo=datetime.timezone.utc)}
2025-12-05 10:40:24 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 10:40:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9db1ea3dd0>
2025-12-05 10:40:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9db1ea8510>